python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1339415 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3629923'] with mtr_portfolio_ids : ['26310890'] and first list_photo_ids : [] new path : /proc/1339415/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 28 ; length of list_pids : 28 ; length of list_args : 28 time to download the photos : 5.234559774398804 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Aug 29 02:30:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10605 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-29 02:30:36.575506: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-29 02:30:36.604588: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-08-29 02:30:36.606913: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f8248000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-29 02:30:36.606957: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-29 02:30:36.611948: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-29 02:30:36.811350: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x257b2a00 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-29 02:30:36.811416: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-29 02:30:36.812961: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-29 02:30:36.813471: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-29 02:30:36.816704: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-29 02:30:36.819972: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-29 02:30:36.820695: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-29 02:30:36.823750: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-29 02:30:36.825349: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-29 02:30:36.831064: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-29 02:30:36.832765: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-29 02:30:36.832889: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-29 02:30:36.837177: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-29 02:30:36.837243: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-29 02:30:36.837254: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-29 02:30:36.839195: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9784 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-29 02:30:37.133354: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-29 02:30:37.133442: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-29 02:30:37.133464: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-29 02:30:37.133483: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-29 02:30:37.133501: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-29 02:30:37.133518: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-29 02:30:37.133535: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-29 02:30:37.133553: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-29 02:30:37.135123: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-29 02:30:37.136674: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-29 02:30:37.136720: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-29 02:30:37.136739: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-29 02:30:37.136756: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-29 02:30:37.136773: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-29 02:30:37.136790: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-29 02:30:37.136807: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-29 02:30:37.136824: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-29 02:30:37.138240: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-29 02:30:37.138277: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-29 02:30:37.138287: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-29 02:30:37.138295: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-29 02:30:37.139624: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9784 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-29 02:30:46.135462: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-29 02:30:46.349837: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 28 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 39.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 Detection mask done ! Trying to reset tf kernel 1340163 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 343 tf kernel not reseted sub process len(results) : 28 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 28 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5632 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0003237724304199219 nb_pixel_total : 7840 time to create 1 rle with old method : 0.008685111999511719 length of segment : 117 time for calcul the mask position with numpy : 0.0018129348754882812 nb_pixel_total : 94815 time to create 1 rle with old method : 0.1030423641204834 length of segment : 506 time for calcul the mask position with numpy : 0.00015878677368164062 nb_pixel_total : 5347 time to create 1 rle with old method : 0.006128072738647461 length of segment : 87 time for calcul the mask position with numpy : 0.000202178955078125 nb_pixel_total : 10849 time to create 1 rle with old method : 0.01207113265991211 length of segment : 139 time for calcul the mask position with numpy : 0.00016617774963378906 nb_pixel_total : 9299 time to create 1 rle with old method : 0.010529756546020508 length of segment : 72 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 1170 time to create 1 rle with old method : 0.001397848129272461 length of segment : 36 time for calcul the mask position with numpy : 0.0017704963684082031 nb_pixel_total : 98603 time to create 1 rle with old method : 0.10610604286193848 length of segment : 518 time for calcul the mask position with numpy : 0.00027751922607421875 nb_pixel_total : 12733 time to create 1 rle with old method : 0.014131307601928711 length of segment : 110 time for calcul the mask position with numpy : 0.00013709068298339844 nb_pixel_total : 6902 time to create 1 rle with old method : 0.007760286331176758 length of segment : 78 time for calcul the mask position with numpy : 0.0001583099365234375 nb_pixel_total : 4707 time to create 1 rle with old method : 0.005498647689819336 length of segment : 74 time for calcul the mask position with numpy : 0.0001327991485595703 nb_pixel_total : 6491 time to create 1 rle with old method : 0.007247447967529297 length of segment : 106 time for calcul the mask position with numpy : 0.000125885009765625 nb_pixel_total : 6389 time to create 1 rle with old method : 0.007379293441772461 length of segment : 75 time for calcul the mask position with numpy : 0.002290487289428711 nb_pixel_total : 100273 time to create 1 rle with old method : 0.10702896118164062 length of segment : 529 time for calcul the mask position with numpy : 0.0004572868347167969 nb_pixel_total : 7808 time to create 1 rle with old method : 0.013013601303100586 length of segment : 140 time for calcul the mask position with numpy : 0.0012676715850830078 nb_pixel_total : 57462 time to create 1 rle with old method : 0.07032585144042969 length of segment : 243 time for calcul the mask position with numpy : 0.0002052783966064453 nb_pixel_total : 4646 time to create 1 rle with old method : 0.0053119659423828125 length of segment : 75 time for calcul the mask position with numpy : 0.0006046295166015625 nb_pixel_total : 11316 time to create 1 rle with old method : 0.012334346771240234 length of segment : 188 time for calcul the mask position with numpy : 0.020633220672607422 nb_pixel_total : 771380 time to create 1 rle with new method : 0.045252323150634766 length of segment : 994 time for calcul the mask position with numpy : 0.00010919570922851562 nb_pixel_total : 2480 time to create 1 rle with old method : 0.003039121627807617 length of segment : 52 time for calcul the mask position with numpy : 0.0002315044403076172 nb_pixel_total : 7545 time to create 1 rle with old method : 0.008953332901000977 length of segment : 107 time for calcul the mask position with numpy : 0.00015854835510253906 nb_pixel_total : 2386 time to create 1 rle with old method : 0.0029027462005615234 length of segment : 56 time for calcul the mask position with numpy : 0.00016260147094726562 nb_pixel_total : 4135 time to create 1 rle with old method : 0.004922628402709961 length of segment : 86 time for calcul the mask position with numpy : 0.00014543533325195312 nb_pixel_total : 3525 time to create 1 rle with old method : 0.004185914993286133 length of segment : 71 time for calcul the mask position with numpy : 0.00019407272338867188 nb_pixel_total : 2541 time to create 1 rle with old method : 0.0030095577239990234 length of segment : 58 time for calcul the mask position with numpy : 0.00019693374633789062 nb_pixel_total : 5834 time to create 1 rle with old method : 0.006667375564575195 length of segment : 120 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 1823 time to create 1 rle with old method : 0.002185821533203125 length of segment : 45 time for calcul the mask position with numpy : 0.0002789497375488281 nb_pixel_total : 7798 time to create 1 rle with old method : 0.008973121643066406 length of segment : 71 time for calcul the mask position with numpy : 0.0026149749755859375 nb_pixel_total : 105352 time to create 1 rle with old method : 0.11623048782348633 length of segment : 509 time for calcul the mask position with numpy : 0.000667572021484375 nb_pixel_total : 20996 time to create 1 rle with old method : 0.0235137939453125 length of segment : 338 time for calcul the mask position with numpy : 0.0001914501190185547 nb_pixel_total : 9493 time to create 1 rle with old method : 0.010591506958007812 length of segment : 160 time for calcul the mask position with numpy : 0.00017452239990234375 nb_pixel_total : 3490 time to create 1 rle with old method : 0.003969669342041016 length of segment : 64 time for calcul the mask position with numpy : 0.0004661083221435547 nb_pixel_total : 12468 time to create 1 rle with old method : 0.014072179794311523 length of segment : 193 time for calcul the mask position with numpy : 0.0001537799835205078 nb_pixel_total : 4917 time to create 1 rle with old method : 0.005483150482177734 length of segment : 118 time for calcul the mask position with numpy : 0.0006799697875976562 nb_pixel_total : 13608 time to create 1 rle with old method : 0.021507978439331055 length of segment : 159 time for calcul the mask position with numpy : 0.0002472400665283203 nb_pixel_total : 1991 time to create 1 rle with old method : 0.004425764083862305 length of segment : 52 time for calcul the mask position with numpy : 0.002592325210571289 nb_pixel_total : 100822 time to create 1 rle with old method : 0.11488771438598633 length of segment : 505 time for calcul the mask position with numpy : 0.00037169456481933594 nb_pixel_total : 10586 time to create 1 rle with old method : 0.019463300704956055 length of segment : 119 time for calcul the mask position with numpy : 0.00034880638122558594 nb_pixel_total : 15078 time to create 1 rle with old method : 0.017648696899414062 length of segment : 229 time for calcul the mask position with numpy : 0.0001773834228515625 nb_pixel_total : 4722 time to create 1 rle with old method : 0.0057811737060546875 length of segment : 75 time for calcul the mask position with numpy : 0.0002741813659667969 nb_pixel_total : 6918 time to create 1 rle with old method : 0.008389472961425781 length of segment : 127 time for calcul the mask position with numpy : 0.00012159347534179688 nb_pixel_total : 5364 time to create 1 rle with old method : 0.006505012512207031 length of segment : 111 time for calcul the mask position with numpy : 0.00023651123046875 nb_pixel_total : 5496 time to create 1 rle with old method : 0.006772756576538086 length of segment : 102 time for calcul the mask position with numpy : 0.00019311904907226562 nb_pixel_total : 7028 time to create 1 rle with old method : 0.008355855941772461 length of segment : 134 time for calcul the mask position with numpy : 0.001214742660522461 nb_pixel_total : 49701 time to create 1 rle with old method : 0.0596315860748291 length of segment : 301 time for calcul the mask position with numpy : 0.002297639846801758 nb_pixel_total : 106508 time to create 1 rle with old method : 0.12973523139953613 length of segment : 511 time for calcul the mask position with numpy : 0.00020885467529296875 nb_pixel_total : 3155 time to create 1 rle with old method : 0.00390625 length of segment : 52 time for calcul the mask position with numpy : 0.00039887428283691406 nb_pixel_total : 10106 time to create 1 rle with old method : 0.012013912200927734 length of segment : 170 time for calcul the mask position with numpy : 0.0001773834228515625 nb_pixel_total : 4371 time to create 1 rle with old method : 0.0054361820220947266 length of segment : 60 time for calcul the mask position with numpy : 0.0006096363067626953 nb_pixel_total : 13439 time to create 1 rle with old method : 0.01580643653869629 length of segment : 156 time for calcul the mask position with numpy : 0.0002353191375732422 nb_pixel_total : 9435 time to create 1 rle with old method : 0.011777162551879883 length of segment : 145 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 2184 time to create 1 rle with old method : 0.002732515335083008 length of segment : 62 time for calcul the mask position with numpy : 0.00035881996154785156 nb_pixel_total : 8530 time to create 1 rle with old method : 0.010183095932006836 length of segment : 127 time for calcul the mask position with numpy : 0.01462101936340332 nb_pixel_total : 705895 time to create 1 rle with new method : 0.018912315368652344 length of segment : 915 time for calcul the mask position with numpy : 0.00029206275939941406 nb_pixel_total : 6441 time to create 1 rle with old method : 0.007752895355224609 length of segment : 119 time for calcul the mask position with numpy : 0.0037620067596435547 nb_pixel_total : 100898 time to create 1 rle with old method : 0.1160116195678711 length of segment : 521 time for calcul the mask position with numpy : 0.0005767345428466797 nb_pixel_total : 15279 time to create 1 rle with old method : 0.025639057159423828 length of segment : 146 time for calcul the mask position with numpy : 0.00029158592224121094 nb_pixel_total : 8178 time to create 1 rle with old method : 0.013870477676391602 length of segment : 72 time for calcul the mask position with numpy : 0.0010497570037841797 nb_pixel_total : 31331 time to create 1 rle with old method : 0.0367429256439209 length of segment : 218 time for calcul the mask position with numpy : 0.0001938343048095703 nb_pixel_total : 9713 time to create 1 rle with old method : 0.01159358024597168 length of segment : 132 time for calcul the mask position with numpy : 0.0005767345428466797 nb_pixel_total : 10308 time to create 1 rle with old method : 0.012326955795288086 length of segment : 180 time for calcul the mask position with numpy : 0.0005154609680175781 nb_pixel_total : 12540 time to create 1 rle with old method : 0.01484370231628418 length of segment : 197 time for calcul the mask position with numpy : 0.00017786026000976562 nb_pixel_total : 4322 time to create 1 rle with old method : 0.0053293704986572266 length of segment : 58 time for calcul the mask position with numpy : 0.002705097198486328 nb_pixel_total : 75654 time to create 1 rle with old method : 0.0861666202545166 length of segment : 391 time for calcul the mask position with numpy : 0.013895511627197266 nb_pixel_total : 744025 time to create 1 rle with new method : 0.023978471755981445 length of segment : 954 time for calcul the mask position with numpy : 0.00042891502380371094 nb_pixel_total : 9926 time to create 1 rle with old method : 0.011058807373046875 length of segment : 170 time for calcul the mask position with numpy : 0.000308990478515625 nb_pixel_total : 10788 time to create 1 rle with old method : 0.012012720108032227 length of segment : 128 time for calcul the mask position with numpy : 0.0003979206085205078 nb_pixel_total : 12952 time to create 1 rle with old method : 0.01438760757446289 length of segment : 190 time for calcul the mask position with numpy : 0.0006108283996582031 nb_pixel_total : 28647 time to create 1 rle with old method : 0.03135538101196289 length of segment : 252 time for calcul the mask position with numpy : 0.00025177001953125 nb_pixel_total : 12118 time to create 1 rle with old method : 0.01358938217163086 length of segment : 143 time for calcul the mask position with numpy : 0.013629674911499023 nb_pixel_total : 876663 time to create 1 rle with new method : 0.03814220428466797 length of segment : 1513 time for calcul the mask position with numpy : 0.002112150192260742 nb_pixel_total : 94936 time to create 1 rle with old method : 0.11014103889465332 length of segment : 487 time for calcul the mask position with numpy : 0.0003199577331542969 nb_pixel_total : 8289 time to create 1 rle with old method : 0.009928226470947266 length of segment : 166 time for calcul the mask position with numpy : 0.0003063678741455078 nb_pixel_total : 12341 time to create 1 rle with old method : 0.01467585563659668 length of segment : 186 time for calcul the mask position with numpy : 0.0004603862762451172 nb_pixel_total : 11894 time to create 1 rle with old method : 0.013955354690551758 length of segment : 184 time for calcul the mask position with numpy : 0.0004093647003173828 nb_pixel_total : 10910 time to create 1 rle with old method : 0.012994766235351562 length of segment : 191 time for calcul the mask position with numpy : 0.0004520416259765625 nb_pixel_total : 10739 time to create 1 rle with old method : 0.012412071228027344 length of segment : 181 time for calcul the mask position with numpy : 0.00021266937255859375 nb_pixel_total : 9823 time to create 1 rle with old method : 0.011641740798950195 length of segment : 143 time for calcul the mask position with numpy : 0.00038313865661621094 nb_pixel_total : 8115 time to create 1 rle with old method : 0.009784221649169922 length of segment : 149 time for calcul the mask position with numpy : 0.00012421607971191406 nb_pixel_total : 2052 time to create 1 rle with old method : 0.002483367919921875 length of segment : 49 time for calcul the mask position with numpy : 0.00037169456481933594 nb_pixel_total : 10709 time to create 1 rle with old method : 0.011861801147460938 length of segment : 211 time for calcul the mask position with numpy : 0.00010132789611816406 nb_pixel_total : 649 time to create 1 rle with old method : 0.0008788108825683594 length of segment : 63 time for calcul the mask position with numpy : 0.0001895427703857422 nb_pixel_total : 6086 time to create 1 rle with old method : 0.007356166839599609 length of segment : 81 time for calcul the mask position with numpy : 0.000614166259765625 nb_pixel_total : 17974 time to create 1 rle with old method : 0.0210726261138916 length of segment : 322 time for calcul the mask position with numpy : 0.00021958351135253906 nb_pixel_total : 4168 time to create 1 rle with old method : 0.0061647891998291016 length of segment : 71 time for calcul the mask position with numpy : 0.00029277801513671875 nb_pixel_total : 5259 time to create 1 rle with old method : 0.006445646286010742 length of segment : 101 time for calcul the mask position with numpy : 0.0002009868621826172 nb_pixel_total : 6897 time to create 1 rle with old method : 0.008340835571289062 length of segment : 86 time for calcul the mask position with numpy : 0.00045228004455566406 nb_pixel_total : 10935 time to create 1 rle with old method : 0.013087987899780273 length of segment : 189 time for calcul the mask position with numpy : 0.002516508102416992 nb_pixel_total : 88643 time to create 1 rle with old method : 0.1062021255493164 length of segment : 503 time for calcul the mask position with numpy : 0.00032901763916015625 nb_pixel_total : 8795 time to create 1 rle with old method : 0.010639667510986328 length of segment : 71 time for calcul the mask position with numpy : 0.0008475780487060547 nb_pixel_total : 20089 time to create 1 rle with old method : 0.02353978157043457 length of segment : 354 time for calcul the mask position with numpy : 0.00041174888610839844 nb_pixel_total : 7270 time to create 1 rle with old method : 0.008855819702148438 length of segment : 132 time for calcul the mask position with numpy : 0.0003693103790283203 nb_pixel_total : 9612 time to create 1 rle with old method : 0.011656761169433594 length of segment : 127 time for calcul the mask position with numpy : 0.00014972686767578125 nb_pixel_total : 2875 time to create 1 rle with old method : 0.003603696823120117 length of segment : 50 time for calcul the mask position with numpy : 0.0002887248992919922 nb_pixel_total : 8757 time to create 1 rle with old method : 0.01058506965637207 length of segment : 160 time for calcul the mask position with numpy : 0.0003840923309326172 nb_pixel_total : 6922 time to create 1 rle with old method : 0.009047508239746094 length of segment : 74 time for calcul the mask position with numpy : 0.0005249977111816406 nb_pixel_total : 15092 time to create 1 rle with old method : 0.018344402313232422 length of segment : 165 time for calcul the mask position with numpy : 0.00014090538024902344 nb_pixel_total : 2393 time to create 1 rle with old method : 0.002863645553588867 length of segment : 56 time for calcul the mask position with numpy : 9.679794311523438e-05 nb_pixel_total : 3211 time to create 1 rle with old method : 0.003961086273193359 length of segment : 58 time for calcul the mask position with numpy : 0.00028967857360839844 nb_pixel_total : 7896 time to create 1 rle with old method : 0.008769035339355469 length of segment : 116 time for calcul the mask position with numpy : 0.0001475811004638672 nb_pixel_total : 3600 time to create 1 rle with old method : 0.0045163631439208984 length of segment : 57 time for calcul the mask position with numpy : 0.0025441646575927734 nb_pixel_total : 108221 time to create 1 rle with old method : 0.12151741981506348 length of segment : 530 time for calcul the mask position with numpy : 0.0003108978271484375 nb_pixel_total : 6388 time to create 1 rle with old method : 0.007132768630981445 length of segment : 97 time for calcul the mask position with numpy : 0.00031685829162597656 nb_pixel_total : 9469 time to create 1 rle with old method : 0.010749101638793945 length of segment : 90 time for calcul the mask position with numpy : 0.0003333091735839844 nb_pixel_total : 7490 time to create 1 rle with old method : 0.008648872375488281 length of segment : 108 time for calcul the mask position with numpy : 0.0005078315734863281 nb_pixel_total : 9613 time to create 1 rle with old method : 0.011146068572998047 length of segment : 166 time for calcul the mask position with numpy : 0.00025200843811035156 nb_pixel_total : 8809 time to create 1 rle with old method : 0.010515213012695312 length of segment : 104 time for calcul the mask position with numpy : 0.00025081634521484375 nb_pixel_total : 10561 time to create 1 rle with old method : 0.011933326721191406 length of segment : 115 time for calcul the mask position with numpy : 0.0012187957763671875 nb_pixel_total : 55254 time to create 1 rle with old method : 0.05999183654785156 length of segment : 293 time spent for convertir_results : 5.885906457901001 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 108 chid ids of type : 3594 Number RLEs to save : 21917 save missing photos in datou_result : time spend for datou_step_exec : 39.211668968200684 time spend to save output : 1.4953813552856445 total time spend for step 1 : 40.70705032348633 step2:crop_condition Fri Aug 29 02:31:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 28 ! batch 1 Loaded 108 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 39 About to insert : list_path_to_insert length 39 new photo from crops ! About to upload 39 photos upload in portfolio : 3736932 init cache_photo without model_param we have 39 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756427476_1339415 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 39 photos in the portfolio 3736932 time of upload the photos Elapsed time : 10.539644479751587 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756427487_1339415 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.7120795249938965 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756427489_1339415 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.49143290519714355 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 44 About to insert : list_path_to_insert length 44 new photo from crops ! About to upload 44 photos upload in portfolio : 3736932 init cache_photo without model_param we have 44 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756427509_1339415 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 44 photos in the portfolio 3736932 time of upload the photos Elapsed time : 13.226773738861084 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 18 About to insert : list_path_to_insert length 18 new photo from crops ! About to upload 18 photos upload in portfolio : 3736932 init cache_photo without model_param we have 18 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756427524_1339415 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 18 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.5644426345825195 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756427529_1339415 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6505093574523926 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1377707272, 1377707267, 1377707263, 1377707209, 1377707208, 1377707207, 1377707206, 1377707203, 1377707199, 1377707183, 1377707175, 1377707167, 1377707160, 1377707142, 1377707139, 1377707130, 1377707127, 1377707123, 1377707114, 1377707101, 1377707088, 1377707051, 1377707049, 1377707047, 1377707045, 1377707043, 1377707029, 1377706973] Looping around the photos to save general results len do output : 108 /1380018042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380018160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707272', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707267', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707263', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707209', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707208', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707207', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707206', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707203', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707199', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707183', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707175', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707167', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707160', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707142', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707139', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707130', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707127', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707123', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707114', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707101', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707088', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707051', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707049', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707047', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707045', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707043', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707029', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377706973', None, None, None, None, None, '3629923') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 352 time used for this insertion : 0.03752541542053223 save_final save missing photos in datou_result : time spend for datou_step_exec : 55.89977216720581 time spend to save output : 0.04252290725708008 total time spend for step 2 : 55.94229507446289 step3:rle_unique_nms_with_priority Fri Aug 29 02:32:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 108 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.2079601287841797 time for calcul the mask position with numpy : 0.03281545639038086 nb_pixel_total : 1944280 time to create 1 rle with new method : 0.12941813468933105 time for calcul the mask position with numpy : 0.0059185028076171875 nb_pixel_total : 1170 time to create 1 rle with old method : 0.0013720989227294922 time for calcul the mask position with numpy : 0.0057141780853271484 nb_pixel_total : 9299 time to create 1 rle with old method : 0.010316133499145508 time for calcul the mask position with numpy : 0.0058917999267578125 nb_pixel_total : 10849 time to create 1 rle with old method : 0.012221574783325195 time for calcul the mask position with numpy : 0.006417751312255859 nb_pixel_total : 5347 time to create 1 rle with old method : 0.006104946136474609 time for calcul the mask position with numpy : 0.007225990295410156 nb_pixel_total : 94815 time to create 1 rle with old method : 0.10889887809753418 time for calcul the mask position with numpy : 0.006336688995361328 nb_pixel_total : 7840 time to create 1 rle with old method : 0.009172439575195312 create new chi : 0.3554515838623047 time to delete rle : 0.017218828201293945 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 2994 TO DO : save crop sub photo not yet done ! save time : 0.21316766738891602 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 0.07569408416748047 time for calcul the mask position with numpy : 0.2734565734863281 nb_pixel_total : 1937775 time to create 1 rle with new method : 0.14252853393554688 time for calcul the mask position with numpy : 0.006173133850097656 nb_pixel_total : 6389 time to create 1 rle with old method : 0.0073604583740234375 time for calcul the mask position with numpy : 0.006040096282958984 nb_pixel_total : 6491 time to create 1 rle with old method : 0.0072116851806640625 time for calcul the mask position with numpy : 0.010074138641357422 nb_pixel_total : 4707 time to create 1 rle with old method : 0.005357027053833008 time for calcul the mask position with numpy : 0.01035928726196289 nb_pixel_total : 6902 time to create 1 rle with old method : 0.00774383544921875 time for calcul the mask position with numpy : 0.010541200637817383 nb_pixel_total : 12733 time to create 1 rle with old method : 0.01582503318786621 time for calcul the mask position with numpy : 0.01098012924194336 nb_pixel_total : 98603 time to create 1 rle with old method : 0.11075210571289062 create new chi : 0.6331002712249756 time to delete rle : 0.00041413307189941406 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 3002 TO DO : save crop sub photo not yet done ! save time : 0.22638940811157227 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.09026217460632324 time for calcul the mask position with numpy : 0.03281354904174805 nb_pixel_total : 1903411 time to create 1 rle with new method : 0.1595010757446289 time for calcul the mask position with numpy : 0.0062084197998046875 nb_pixel_total : 4646 time to create 1 rle with old method : 0.005200386047363281 time for calcul the mask position with numpy : 0.006458759307861328 nb_pixel_total : 57462 time to create 1 rle with old method : 0.06045722961425781 time for calcul the mask position with numpy : 0.005825996398925781 nb_pixel_total : 7808 time to create 1 rle with old method : 0.008464574813842773 time for calcul the mask position with numpy : 0.006487607955932617 nb_pixel_total : 100273 time to create 1 rle with old method : 0.1139986515045166 create new chi : 0.4059422016143799 time to delete rle : 0.0004317760467529297 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 3054 TO DO : save crop sub photo not yet done ! save time : 0.22684049606323242 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.05573606491088867 time for calcul the mask position with numpy : 0.015628814697265625 nb_pixel_total : 1289281 time to create 1 rle with new method : 0.030942678451538086 time for calcul the mask position with numpy : 0.0060596466064453125 nb_pixel_total : 2480 time to create 1 rle with old method : 0.0029070377349853516 time for calcul the mask position with numpy : 0.012037515640258789 nb_pixel_total : 770523 time to create 1 rle with new method : 0.029544830322265625 time for calcul the mask position with numpy : 0.00592350959777832 nb_pixel_total : 11316 time to create 1 rle with old method : 0.012645483016967773 create new chi : 0.11630940437316895 time to delete rle : 0.0005621910095214844 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3474 TO DO : save crop sub photo not yet done ! save time : 0.21146750450134277 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 0.09842228889465332 time for calcul the mask position with numpy : 0.08508682250976562 nb_pixel_total : 2038013 time to create 1 rle with new method : 0.0788116455078125 time for calcul the mask position with numpy : 0.00577855110168457 nb_pixel_total : 7798 time to create 1 rle with old method : 0.008416414260864258 time for calcul the mask position with numpy : 0.005764007568359375 nb_pixel_total : 1823 time to create 1 rle with old method : 0.0019941329956054688 time for calcul the mask position with numpy : 0.005751848220825195 nb_pixel_total : 5834 time to create 1 rle with old method : 0.0063037872314453125 time for calcul the mask position with numpy : 0.0060062408447265625 nb_pixel_total : 2541 time to create 1 rle with old method : 0.0027358531951904297 time for calcul the mask position with numpy : 0.005722761154174805 nb_pixel_total : 3525 time to create 1 rle with old method : 0.004002094268798828 time for calcul the mask position with numpy : 0.005693912506103516 nb_pixel_total : 4135 time to create 1 rle with old method : 0.004498958587646484 time for calcul the mask position with numpy : 0.0057713985443115234 nb_pixel_total : 2386 time to create 1 rle with old method : 0.00260162353515625 time for calcul the mask position with numpy : 0.00602412223815918 nb_pixel_total : 7545 time to create 1 rle with old method : 0.008108377456665039 create new chi : 0.25965404510498047 time to delete rle : 0.0003814697265625 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++Number RLEs to save : 2308 TO DO : save crop sub photo not yet done ! save time : 0.1713120937347412 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.06848502159118652 time for calcul the mask position with numpy : 0.026474475860595703 nb_pixel_total : 1934269 time to create 1 rle with new method : 0.04030919075012207 time for calcul the mask position with numpy : 0.007241010665893555 nb_pixel_total : 3490 time to create 1 rle with old method : 0.003951072692871094 time for calcul the mask position with numpy : 0.0071315765380859375 nb_pixel_total : 9493 time to create 1 rle with old method : 0.010592937469482422 time for calcul the mask position with numpy : 0.007567882537841797 nb_pixel_total : 20996 time to create 1 rle with old method : 0.023470401763916016 time for calcul the mask position with numpy : 0.007080078125 nb_pixel_total : 105352 time to create 1 rle with old method : 0.11455583572387695 create new chi : 0.24908733367919922 time to delete rle : 0.0004899501800537109 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3222 TO DO : save crop sub photo not yet done ! save time : 0.2207813262939453 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.043317556381225586 time for calcul the mask position with numpy : 0.02885746955871582 nb_pixel_total : 2056215 time to create 1 rle with new method : 0.036180734634399414 time for calcul the mask position with numpy : 0.006097555160522461 nb_pixel_total : 4917 time to create 1 rle with old method : 0.0053751468658447266 time for calcul the mask position with numpy : 0.007142782211303711 nb_pixel_total : 12468 time to create 1 rle with old method : 0.01364755630493164 create new chi : 0.09759664535522461 time to delete rle : 0.0003440380096435547 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1702 TO DO : save crop sub photo not yet done ! save time : 0.14307713508605957 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.0745246410369873 time for calcul the mask position with numpy : 0.033438682556152344 nb_pixel_total : 1926793 time to create 1 rle with new method : 0.3190934658050537 time for calcul the mask position with numpy : 0.00615382194519043 nb_pixel_total : 4722 time to create 1 rle with old method : 0.005181550979614258 time for calcul the mask position with numpy : 0.006092071533203125 nb_pixel_total : 15078 time to create 1 rle with old method : 0.016188621520996094 time for calcul the mask position with numpy : 0.005904674530029297 nb_pixel_total : 10586 time to create 1 rle with old method : 0.011554479598999023 time for calcul the mask position with numpy : 0.006400108337402344 nb_pixel_total : 100822 time to create 1 rle with old method : 0.10968470573425293 time for calcul the mask position with numpy : 0.00608515739440918 nb_pixel_total : 1991 time to create 1 rle with old method : 0.0023217201232910156 time for calcul the mask position with numpy : 0.006067037582397461 nb_pixel_total : 13608 time to create 1 rle with old method : 0.01567983627319336 create new chi : 0.5585203170776367 time to delete rle : 0.0006330013275146484 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 3358 TO DO : save crop sub photo not yet done ! save time : 0.24500727653503418 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.07994508743286133 time for calcul the mask position with numpy : 0.01867961883544922 nb_pixel_total : 2061328 time to create 1 rle with new method : 0.02739429473876953 time for calcul the mask position with numpy : 0.005949735641479492 nb_pixel_total : 5354 time to create 1 rle with old method : 0.005845546722412109 time for calcul the mask position with numpy : 0.0058290958404541016 nb_pixel_total : 6918 time to create 1 rle with old method : 0.007287263870239258 create new chi : 0.07132530212402344 time to delete rle : 0.0003192424774169922 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1515 TO DO : save crop sub photo not yet done ! save time : 0.145432710647583 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.07006502151489258 time for calcul the mask position with numpy : 0.02601146697998047 nb_pixel_total : 2011375 time to create 1 rle with new method : 0.06195855140686035 time for calcul the mask position with numpy : 0.006743907928466797 nb_pixel_total : 49701 time to create 1 rle with old method : 0.05648493766784668 time for calcul the mask position with numpy : 0.005949497222900391 nb_pixel_total : 7028 time to create 1 rle with old method : 0.007892370223999023 time for calcul the mask position with numpy : 0.0058977603912353516 nb_pixel_total : 5496 time to create 1 rle with old method : 0.005967617034912109 create new chi : 0.1772918701171875 time to delete rle : 0.00034999847412109375 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 2154 TO DO : save crop sub photo not yet done ! save time : 0.17432379722595215 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.057062625885009766 time for calcul the mask position with numpy : 0.019970178604125977 nb_pixel_total : 1949460 time to create 1 rle with new method : 0.21231460571289062 time for calcul the mask position with numpy : 0.0058672428131103516 nb_pixel_total : 4371 time to create 1 rle with old method : 0.00492405891418457 time for calcul the mask position with numpy : 0.005723714828491211 nb_pixel_total : 10106 time to create 1 rle with old method : 0.010712146759033203 time for calcul the mask position with numpy : 0.0059206485748291016 nb_pixel_total : 3155 time to create 1 rle with old method : 0.003535747528076172 time for calcul the mask position with numpy : 0.006391763687133789 nb_pixel_total : 106508 time to create 1 rle with old method : 0.11419463157653809 create new chi : 0.38998937606811523 time to delete rle : 0.0004100799560546875 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2666 TO DO : save crop sub photo not yet done ! save time : 0.1998295783996582 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.08416914939880371 time for calcul the mask position with numpy : 0.015409708023071289 nb_pixel_total : 1329622 time to create 1 rle with new method : 0.030194997787475586 time for calcul the mask position with numpy : 0.0067522525787353516 nb_pixel_total : 6441 time to create 1 rle with old method : 0.007014274597167969 time for calcul the mask position with numpy : 0.01030278205871582 nb_pixel_total : 705895 time to create 1 rle with new method : 0.029608726501464844 time for calcul the mask position with numpy : 0.005812644958496094 nb_pixel_total : 8530 time to create 1 rle with old method : 0.009338140487670898 time for calcul the mask position with numpy : 0.006039142608642578 nb_pixel_total : 2184 time to create 1 rle with old method : 0.0025255680084228516 time for calcul the mask position with numpy : 0.006063938140869141 nb_pixel_total : 7489 time to create 1 rle with old method : 0.008340120315551758 time for calcul the mask position with numpy : 0.006341457366943359 nb_pixel_total : 13439 time to create 1 rle with old method : 0.01507568359375 create new chi : 0.15943241119384766 time to delete rle : 0.0007228851318359375 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 4089 TO DO : save crop sub photo not yet done ! save time : 0.28499531745910645 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03342795372009277 time for calcul the mask position with numpy : 0.020662784576416016 nb_pixel_total : 1972702 time to create 1 rle with new method : 0.02791428565979004 time for calcul the mask position with numpy : 0.006727457046508789 nb_pixel_total : 100898 time to create 1 rle with old method : 0.10835647583007812 create new chi : 0.16401457786560059 time to delete rle : 0.0003540515899658203 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 2122 TO DO : save crop sub photo not yet done ! save time : 0.1959850788116455 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.05595278739929199 time for calcul the mask position with numpy : 0.02002716064453125 nb_pixel_total : 2018812 time to create 1 rle with new method : 0.028850078582763672 time for calcul the mask position with numpy : 0.006104707717895508 nb_pixel_total : 31331 time to create 1 rle with old method : 0.03520989418029785 time for calcul the mask position with numpy : 0.0064470767974853516 nb_pixel_total : 8178 time to create 1 rle with old method : 0.009604454040527344 time for calcul the mask position with numpy : 0.006744384765625 nb_pixel_total : 15279 time to create 1 rle with old method : 0.01786518096923828 create new chi : 0.13120126724243164 time to delete rle : 0.0004191398620605469 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1952 TO DO : save crop sub photo not yet done ! save time : 0.36524295806884766 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.0762484073638916 time for calcul the mask position with numpy : 0.013699769973754883 nb_pixel_total : 1217547 time to create 1 rle with new method : 0.16367435455322266 time for calcul the mask position with numpy : 0.012186527252197266 nb_pixel_total : 743516 time to create 1 rle with new method : 0.0730288028717041 time for calcul the mask position with numpy : 0.00625920295715332 nb_pixel_total : 75654 time to create 1 rle with old method : 0.08354449272155762 time for calcul the mask position with numpy : 0.006848573684692383 nb_pixel_total : 4322 time to create 1 rle with old method : 0.004868268966674805 time for calcul the mask position with numpy : 0.006193637847900391 nb_pixel_total : 12540 time to create 1 rle with old method : 0.01398324966430664 time for calcul the mask position with numpy : 0.006783246994018555 nb_pixel_total : 10308 time to create 1 rle with old method : 0.011417627334594727 time for calcul the mask position with numpy : 0.005904197692871094 nb_pixel_total : 9713 time to create 1 rle with old method : 0.010614633560180664 create new chi : 0.4278445243835449 time to delete rle : 0.0006911754608154297 batch 1 Loaded 13 chid ids of type : 3594 +++++++++Number RLEs to save : 4846 TO DO : save crop sub photo not yet done ! save time : 0.343764066696167 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.09547734260559082 time for calcul the mask position with numpy : 0.013564586639404297 nb_pixel_total : 1131187 time to create 1 rle with new method : 0.19169259071350098 time for calcul the mask position with numpy : 0.012064933776855469 nb_pixel_total : 867982 time to create 1 rle with new method : 0.030756711959838867 time for calcul the mask position with numpy : 0.006220102310180664 nb_pixel_total : 12118 time to create 1 rle with old method : 0.012820720672607422 time for calcul the mask position with numpy : 0.006039142608642578 nb_pixel_total : 28647 time to create 1 rle with old method : 0.030794858932495117 time for calcul the mask position with numpy : 0.005777120590209961 nb_pixel_total : 12952 time to create 1 rle with old method : 0.013710975646972656 time for calcul the mask position with numpy : 0.006202220916748047 nb_pixel_total : 10788 time to create 1 rle with old method : 0.01179194450378418 time for calcul the mask position with numpy : 0.006012439727783203 nb_pixel_total : 9926 time to create 1 rle with old method : 0.011006593704223633 create new chi : 0.35922861099243164 time to delete rle : 0.0009653568267822266 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 5693 TO DO : save crop sub photo not yet done ! save time : 0.3749806880950928 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.052268266677856445 time for calcul the mask position with numpy : 0.01918315887451172 nb_pixel_total : 1958034 time to create 1 rle with new method : 0.03698539733886719 time for calcul the mask position with numpy : 0.007357358932495117 nb_pixel_total : 12341 time to create 1 rle with old method : 0.013330459594726562 time for calcul the mask position with numpy : 0.006462574005126953 nb_pixel_total : 8289 time to create 1 rle with old method : 0.008928775787353516 time for calcul the mask position with numpy : 0.00761866569519043 nb_pixel_total : 94936 time to create 1 rle with old method : 0.10352969169616699 create new chi : 0.20389008522033691 time to delete rle : 0.00035309791564941406 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2758 TO DO : save crop sub photo not yet done ! save time : 0.2044079303741455 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.037657976150512695 time for calcul the mask position with numpy : 0.023578405380249023 nb_pixel_total : 2061706 time to create 1 rle with new method : 0.028399944305419922 time for calcul the mask position with numpy : 0.00606226921081543 nb_pixel_total : 11894 time to create 1 rle with old method : 0.013022661209106445 create new chi : 0.07130789756774902 time to delete rle : 0.00027489662170410156 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1448 TO DO : save crop sub photo not yet done ! save time : 0.1243891716003418 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.04938340187072754 time for calcul the mask position with numpy : 0.020398616790771484 nb_pixel_total : 2042128 time to create 1 rle with new method : 0.04240679740905762 time for calcul the mask position with numpy : 0.0065021514892578125 nb_pixel_total : 9823 time to create 1 rle with old method : 0.01061868667602539 time for calcul the mask position with numpy : 0.010287046432495117 nb_pixel_total : 10739 time to create 1 rle with old method : 0.011659383773803711 time for calcul the mask position with numpy : 0.009886503219604492 nb_pixel_total : 10910 time to create 1 rle with old method : 0.011347055435180664 create new chi : 0.12351107597351074 time to delete rle : 0.00042247772216796875 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2110 TO DO : save crop sub photo not yet done ! save time : 0.17826271057128906 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.10753798484802246 time for calcul the mask position with numpy : 0.02500176429748535 nb_pixel_total : 2045989 time to create 1 rle with new method : 0.034085750579833984 time for calcul the mask position with numpy : 0.007286787033081055 nb_pixel_total : 6086 time to create 1 rle with old method : 0.0069122314453125 time for calcul the mask position with numpy : 0.0061833858489990234 nb_pixel_total : 649 time to create 1 rle with old method : 0.0007517337799072266 time for calcul the mask position with numpy : 0.006078243255615234 nb_pixel_total : 10709 time to create 1 rle with old method : 0.01180124282836914 time for calcul the mask position with numpy : 0.006363391876220703 nb_pixel_total : 2052 time to create 1 rle with old method : 0.0023720264434814453 time for calcul the mask position with numpy : 0.006232500076293945 nb_pixel_total : 8115 time to create 1 rle with old method : 0.009342670440673828 create new chi : 0.8033151626586914 time to delete rle : 0.0003979206085205078 batch 1 Loaded 11 chid ids of type : 3594 +++++++++++Number RLEs to save : 2186 TO DO : save crop sub photo not yet done ! save time : 0.17667365074157715 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.0638885498046875 time for calcul the mask position with numpy : 0.022344589233398438 nb_pixel_total : 2039302 time to create 1 rle with new method : 0.039063215255737305 time for calcul the mask position with numpy : 0.009622573852539062 nb_pixel_total : 6897 time to create 1 rle with old method : 0.007558345794677734 time for calcul the mask position with numpy : 0.009737491607666016 nb_pixel_total : 5259 time to create 1 rle with old method : 0.005893707275390625 time for calcul the mask position with numpy : 0.009936332702636719 nb_pixel_total : 4168 time to create 1 rle with old method : 0.004626750946044922 time for calcul the mask position with numpy : 0.005930662155151367 nb_pixel_total : 17974 time to create 1 rle with old method : 0.01949453353881836 create new chi : 0.13464879989624023 time to delete rle : 0.0004150867462158203 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 2240 TO DO : save crop sub photo not yet done ! save time : 0.18368768692016602 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.07491564750671387 time for calcul the mask position with numpy : 0.02069878578186035 nb_pixel_total : 1974022 time to create 1 rle with new method : 0.03150582313537598 time for calcul the mask position with numpy : 0.006883859634399414 nb_pixel_total : 88643 time to create 1 rle with old method : 0.10021519660949707 time for calcul the mask position with numpy : 0.006174564361572266 nb_pixel_total : 10935 time to create 1 rle with old method : 0.012293100357055664 create new chi : 0.17823433876037598 time to delete rle : 0.00045561790466308594 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2464 TO DO : save crop sub photo not yet done ! save time : 0.20528292655944824 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.08867788314819336 time for calcul the mask position with numpy : 0.025574207305908203 nb_pixel_total : 2016202 time to create 1 rle with new method : 0.042441606521606445 time for calcul the mask position with numpy : 0.0070993900299072266 nb_pixel_total : 8757 time to create 1 rle with old method : 0.009918212890625 time for calcul the mask position with numpy : 0.0062944889068603516 nb_pixel_total : 2875 time to create 1 rle with old method : 0.0032324790954589844 time for calcul the mask position with numpy : 0.006489992141723633 nb_pixel_total : 9612 time to create 1 rle with old method : 0.010993480682373047 time for calcul the mask position with numpy : 0.006619691848754883 nb_pixel_total : 7270 time to create 1 rle with old method : 0.007774829864501953 time for calcul the mask position with numpy : 0.00638580322265625 nb_pixel_total : 20089 time to create 1 rle with old method : 0.02269721031188965 time for calcul the mask position with numpy : 0.006241798400878906 nb_pixel_total : 8795 time to create 1 rle with old method : 0.010084867477416992 create new chi : 0.1725149154663086 time to delete rle : 0.0005106925964355469 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 2868 TO DO : save crop sub photo not yet done ! save time : 0.2109212875366211 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.0378880500793457 time for calcul the mask position with numpy : 0.02097463607788086 nb_pixel_total : 2066678 time to create 1 rle with new method : 0.029959678649902344 time for calcul the mask position with numpy : 0.006233692169189453 nb_pixel_total : 6922 time to create 1 rle with old method : 0.007541179656982422 create new chi : 0.06492805480957031 time to delete rle : 0.00021839141845703125 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1228 TO DO : save crop sub photo not yet done ! save time : 0.11958694458007812 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.04528641700744629 time for calcul the mask position with numpy : 0.02298569679260254 nb_pixel_total : 2052904 time to create 1 rle with new method : 0.03205704689025879 time for calcul the mask position with numpy : 0.006144523620605469 nb_pixel_total : 3211 time to create 1 rle with old method : 0.003587007522583008 time for calcul the mask position with numpy : 0.009876251220703125 nb_pixel_total : 2393 time to create 1 rle with old method : 0.002698659896850586 time for calcul the mask position with numpy : 0.006843090057373047 nb_pixel_total : 15092 time to create 1 rle with old method : 0.024430036544799805 create new chi : 0.10894441604614258 time to delete rle : 0.00040221214294433594 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1638 TO DO : save crop sub photo not yet done ! save time : 0.13407278060913086 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.08977413177490234 time for calcul the mask position with numpy : 0.020949840545654297 nb_pixel_total : 2062104 time to create 1 rle with new method : 0.030482053756713867 time for calcul the mask position with numpy : 0.0063478946685791016 nb_pixel_total : 3600 time to create 1 rle with old method : 0.004068851470947266 time for calcul the mask position with numpy : 0.006016731262207031 nb_pixel_total : 7896 time to create 1 rle with old method : 0.00879526138305664 create new chi : 0.07692790031433105 time to delete rle : 0.000301361083984375 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1426 TO DO : save crop sub photo not yet done ! save time : 0.12895917892456055 nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 0.08034062385559082 time for calcul the mask position with numpy : 0.0208895206451416 nb_pixel_total : 1913049 time to create 1 rle with new method : 0.08316278457641602 time for calcul the mask position with numpy : 0.006512641906738281 nb_pixel_total : 10561 time to create 1 rle with old method : 0.011478185653686523 time for calcul the mask position with numpy : 0.007056713104248047 nb_pixel_total : 8809 time to create 1 rle with old method : 0.009375810623168945 time for calcul the mask position with numpy : 0.0065310001373291016 nb_pixel_total : 9613 time to create 1 rle with old method : 0.010532379150390625 time for calcul the mask position with numpy : 0.005933046340942383 nb_pixel_total : 7490 time to create 1 rle with old method : 0.008902788162231445 time for calcul the mask position with numpy : 0.006242990493774414 nb_pixel_total : 9469 time to create 1 rle with old method : 0.010882377624511719 time for calcul the mask position with numpy : 0.006158590316772461 nb_pixel_total : 6388 time to create 1 rle with old method : 0.007035970687866211 time for calcul the mask position with numpy : 0.006362438201904297 nb_pixel_total : 108221 time to create 1 rle with old method : 0.11986303329467773 create new chi : 0.33795857429504395 time to delete rle : 0.0009207725524902344 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 3500 TO DO : save crop sub photo not yet done ! save time : 0.22977423667907715 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.08265042304992676 time for calcul the mask position with numpy : 0.04484987258911133 nb_pixel_total : 2018346 time to create 1 rle with new method : 0.04117155075073242 time for calcul the mask position with numpy : 0.010400772094726562 nb_pixel_total : 55254 time to create 1 rle with old method : 0.1003572940826416 create new chi : 0.19743776321411133 time to delete rle : 0.0006349086761474609 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1666 TO DO : save crop sub photo not yet done ! save time : 0.15119004249572754 map_output_result : {1377707272: (0.0, 'Should be the crop_list due to order', 0), 1377707267: (0.0, 'Should be the crop_list due to order', 0), 1377707263: (0.0, 'Should be the crop_list due to order', 0), 1377707209: (0.0, 'Should be the crop_list due to order', 0), 1377707208: (0.0, 'Should be the crop_list due to order', 0), 1377707207: (0.0, 'Should be the crop_list due to order', 0), 1377707206: (0.0, 'Should be the crop_list due to order', 0), 1377707203: (0.0, 'Should be the crop_list due to order', 0), 1377707199: (0.0, 'Should be the crop_list due to order', 0), 1377707183: (0.0, 'Should be the crop_list due to order', 0), 1377707175: (0.0, 'Should be the crop_list due to order', 0), 1377707167: (0.0, 'Should be the crop_list due to order', 0), 1377707160: (0.0, 'Should be the crop_list due to order', 0), 1377707142: (0.0, 'Should be the crop_list due to order', 0), 1377707139: (0.0, 'Should be the crop_list due to order', 0), 1377707130: (0.0, 'Should be the crop_list due to order', 0), 1377707127: (0.0, 'Should be the crop_list due to order', 0), 1377707123: (0.0, 'Should be the crop_list due to order', 0), 1377707114: (0.0, 'Should be the crop_list due to order', 0), 1377707101: (0.0, 'Should be the crop_list due to order', 0), 1377707088: (0.0, 'Should be the crop_list due to order', 0), 1377707051: (0.0, 'Should be the crop_list due to order', 0), 1377707049: (0.0, 'Should be the crop_list due to order', 0), 1377707047: (0.0, 'Should be the crop_list due to order', 0), 1377707045: (0.0, 'Should be the crop_list due to order', 0), 1377707043: (0.0, 'Should be the crop_list due to order', 0), 1377707029: (0.0, 'Should be the crop_list due to order', 0), 1377706973: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1377707272, 1377707267, 1377707263, 1377707209, 1377707208, 1377707207, 1377707206, 1377707203, 1377707199, 1377707183, 1377707175, 1377707167, 1377707160, 1377707142, 1377707139, 1377707130, 1377707127, 1377707123, 1377707114, 1377707101, 1377707088, 1377707051, 1377707049, 1377707047, 1377707045, 1377707043, 1377707029, 1377706973] Looping around the photos to save general results len do output : 28 /1377707272.Didn't retrieve data . /1377707267.Didn't retrieve data . /1377707263.Didn't retrieve data . /1377707209.Didn't retrieve data . /1377707208.Didn't retrieve data . /1377707207.Didn't retrieve data . /1377707206.Didn't retrieve data . /1377707203.Didn't retrieve data . /1377707199.Didn't retrieve data . /1377707183.Didn't retrieve data . /1377707175.Didn't retrieve data . /1377707167.Didn't retrieve data . /1377707160.Didn't retrieve data . /1377707142.Didn't retrieve data . /1377707139.Didn't retrieve data . /1377707130.Didn't retrieve data . /1377707127.Didn't retrieve data . /1377707123.Didn't retrieve data . /1377707114.Didn't retrieve data . /1377707101.Didn't retrieve data . /1377707088.Didn't retrieve data . /1377707051.Didn't retrieve data . /1377707049.Didn't retrieve data . /1377707047.Didn't retrieve data . /1377707045.Didn't retrieve data . /1377707043.Didn't retrieve data . /1377707029.Didn't retrieve data . /1377706973.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707272', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707267', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707263', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707209', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707208', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707207', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707206', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707203', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707199', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707183', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707175', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707167', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707160', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707142', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707139', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707130', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707127', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707123', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707114', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707101', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707088', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707051', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707049', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707047', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707045', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707043', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707029', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377706973', None, None, None, None, None, '3629923') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 84 time used for this insertion : 0.017950057983398438 save_final save missing photos in datou_result : time spend for datou_step_exec : 15.812589406967163 time spend to save output : 0.01921248435974121 total time spend for step 3 : 15.831801891326904 step4:ventilate_hashtags_in_portfolio Fri Aug 29 02:32:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26310890 get user id for portfolio 26310890 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26310890 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','pet_fonce','background','environnement','pet_clair','pehd','carton','metal','papier','flou','mal_croppe')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26310890 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','pet_fonce','background','environnement','pet_clair','pehd','carton','metal','papier','flou','mal_croppe')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26310890 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','pet_fonce','background','environnement','pet_clair','pehd','carton','metal','papier','flou','mal_croppe')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/26313500,26313501,26313502,26313503,26313504,26313505,26313506,26313507,26313508,26313509,26313510?tags=autre,pet_fonce,background,environnement,pet_clair,pehd,carton,metal,papier,flou,mal_croppe Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1377707272, 1377707267, 1377707263, 1377707209, 1377707208, 1377707207, 1377707206, 1377707203, 1377707199, 1377707183, 1377707175, 1377707167, 1377707160, 1377707142, 1377707139, 1377707130, 1377707127, 1377707123, 1377707114, 1377707101, 1377707088, 1377707051, 1377707049, 1377707047, 1377707045, 1377707043, 1377707029, 1377706973] Looping around the photos to save general results len do output : 1 /26310890. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707272', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707267', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707263', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707209', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707208', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707207', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707206', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707203', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707199', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707183', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707175', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707167', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707160', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707142', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707139', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707130', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707127', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707123', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707114', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707101', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707088', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707051', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707049', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707047', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707045', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707043', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707029', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377706973', None, None, None, None, None, '3629923') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 29 time used for this insertion : 0.01727008819580078 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.812971830368042 time spend to save output : 0.017812490463256836 total time spend for step 4 : 1.8307843208312988 step5:final Fri Aug 29 02:32:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1377707272: ('0.08763685653659609',), 1377707267: ('0.08763685653659609',), 1377707263: ('0.08763685653659609',), 1377707209: ('0.08763685653659609',), 1377707208: ('0.08763685653659609',), 1377707207: ('0.08763685653659609',), 1377707206: ('0.08763685653659609',), 1377707203: ('0.08763685653659609',), 1377707199: ('0.08763685653659609',), 1377707183: ('0.08763685653659609',), 1377707175: ('0.08763685653659609',), 1377707167: ('0.08763685653659609',), 1377707160: ('0.08763685653659609',), 1377707142: ('0.08763685653659609',), 1377707139: ('0.08763685653659609',), 1377707130: ('0.08763685653659609',), 1377707127: ('0.08763685653659609',), 1377707123: ('0.08763685653659609',), 1377707114: ('0.08763685653659609',), 1377707101: ('0.08763685653659609',), 1377707088: ('0.08763685653659609',), 1377707051: ('0.08763685653659609',), 1377707049: ('0.08763685653659609',), 1377707047: ('0.08763685653659609',), 1377707045: ('0.08763685653659609',), 1377707043: ('0.08763685653659609',), 1377707029: ('0.08763685653659609',), 1377706973: ('0.08763685653659609',)} new output for save of step final : {1377707272: ('0.08763685653659609',), 1377707267: ('0.08763685653659609',), 1377707263: ('0.08763685653659609',), 1377707209: ('0.08763685653659609',), 1377707208: ('0.08763685653659609',), 1377707207: ('0.08763685653659609',), 1377707206: ('0.08763685653659609',), 1377707203: ('0.08763685653659609',), 1377707199: ('0.08763685653659609',), 1377707183: ('0.08763685653659609',), 1377707175: ('0.08763685653659609',), 1377707167: ('0.08763685653659609',), 1377707160: ('0.08763685653659609',), 1377707142: ('0.08763685653659609',), 1377707139: ('0.08763685653659609',), 1377707130: ('0.08763685653659609',), 1377707127: ('0.08763685653659609',), 1377707123: ('0.08763685653659609',), 1377707114: ('0.08763685653659609',), 1377707101: ('0.08763685653659609',), 1377707088: ('0.08763685653659609',), 1377707051: ('0.08763685653659609',), 1377707049: ('0.08763685653659609',), 1377707047: ('0.08763685653659609',), 1377707045: ('0.08763685653659609',), 1377707043: ('0.08763685653659609',), 1377707029: ('0.08763685653659609',), 1377706973: ('0.08763685653659609',)} [1377707272, 1377707267, 1377707263, 1377707209, 1377707208, 1377707207, 1377707206, 1377707203, 1377707199, 1377707183, 1377707175, 1377707167, 1377707160, 1377707142, 1377707139, 1377707130, 1377707127, 1377707123, 1377707114, 1377707101, 1377707088, 1377707051, 1377707049, 1377707047, 1377707045, 1377707043, 1377707029, 1377706973] Looping around the photos to save general results len do output : 28 /1377707272.Didn't retrieve data . /1377707267.Didn't retrieve data . /1377707263.Didn't retrieve data . /1377707209.Didn't retrieve data . /1377707208.Didn't retrieve data . /1377707207.Didn't retrieve data . /1377707206.Didn't retrieve data . /1377707203.Didn't retrieve data . /1377707199.Didn't retrieve data . /1377707183.Didn't retrieve data . /1377707175.Didn't retrieve data . /1377707167.Didn't retrieve data . /1377707160.Didn't retrieve data . /1377707142.Didn't retrieve data . /1377707139.Didn't retrieve data . /1377707130.Didn't retrieve data . /1377707127.Didn't retrieve data . /1377707123.Didn't retrieve data . /1377707114.Didn't retrieve data . /1377707101.Didn't retrieve data . /1377707088.Didn't retrieve data . /1377707051.Didn't retrieve data . /1377707049.Didn't retrieve data . /1377707047.Didn't retrieve data . /1377707045.Didn't retrieve data . /1377707043.Didn't retrieve data . /1377707029.Didn't retrieve data . /1377706973.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707272', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707267', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707263', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707209', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707208', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707207', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707206', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707203', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707199', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707183', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707175', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707167', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707160', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707142', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707139', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707130', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707127', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707123', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707114', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707101', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707088', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707051', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707049', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707047', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707045', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707043', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707029', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377706973', None, None, None, None, None, '3629923') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 84 time used for this insertion : 0.020296812057495117 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1344127655029297 time spend to save output : 0.02210545539855957 total time spend for step 5 : 0.15651822090148926 step6:blur_detection Fri Aug 29 02:32:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1756427427_1339415_1377707272_0cfe6985abaa484338ef3afcd475d6ee.jpg resize: (1080, 1920) 1377707272 -2.104801325281092 treat image : temp/1756427427_1339415_1377707267_ef5db760682f2097294bee0a278f86b3.jpg resize: (1080, 1920) 1377707267 -0.4194407748841918 treat image : temp/1756427427_1339415_1377707263_cb1f51363530402d74979aebe45de4d4.jpg resize: (1080, 1920) 1377707263 -2.0754444820217595 treat image : temp/1756427427_1339415_1377707209_7e090351a911d65257fe5e51d1cc195a.jpg resize: (1080, 1920) 1377707209 -2.085243784703612 treat image : temp/1756427427_1339415_1377707208_6f9e89d3b080067e1f50b2c9e159d48d.jpg resize: (1080, 1920) 1377707208 -3.903668385824852 treat image : temp/1756427427_1339415_1377707207_2568a89df09cdb811b468e040a884a40.jpg resize: (1080, 1920) 1377707207 -0.982880606708402 treat image : temp/1756427427_1339415_1377707206_bf4939c1d03213dac5c06b36286e956f.jpg resize: (1080, 1920) 1377707206 -1.9824925399828082 treat image : temp/1756427427_1339415_1377707203_4fdb9f49cde75185f3d7b79613e0d5fc.jpg resize: (1080, 1920) 1377707203 -2.2935273307488826 treat image : temp/1756427427_1339415_1377707199_17733fc4116b5bf188e6340d7d21263c.jpg resize: (1080, 1920) 1377707199 -1.8679951825298 treat image : temp/1756427427_1339415_1377707183_4b1f67e46c3235c1eda0eb0869f46e9b.jpg resize: (1080, 1920) 1377707183 -1.9849091638862424 treat image : temp/1756427427_1339415_1377707175_269d94a218e6e1563c72ca459801a457.jpg resize: (1080, 1920) 1377707175 -1.9796851457409652 treat image : temp/1756427427_1339415_1377707167_ec4947608b1dafc0a856b660912c78c7.jpg resize: (1080, 1920) 1377707167 -2.239929939956396 treat image : temp/1756427427_1339415_1377707160_a6e68b12faa966f8929850dd95477d93.jpg resize: (1080, 1920) 1377707160 -2.2715276066778136 treat image : temp/1756427427_1339415_1377707142_06138e3da9de0bc8b08f70f29708549d.jpg resize: (1080, 1920) 1377707142 -2.112518585835347 treat image : temp/1756427427_1339415_1377707139_e1090e067fe03fe5e17e93646fcc627d.jpg resize: (1080, 1920) 1377707139 -2.1894132202131176 treat image : temp/1756427427_1339415_1377707130_e59f20f49171c3bdb0c91c770a68ee6e.jpg resize: (1080, 1920) 1377707130 -1.7859927284368395 treat image : temp/1756427427_1339415_1377707127_b2e0372c6331c02f11c8b5635660af41.jpg resize: (1080, 1920) 1377707127 -1.1046266225593975 treat image : temp/1756427427_1339415_1377707123_52b9ba63765d6fb0a1129a1463af7b4f.jpg resize: (1080, 1920) 1377707123 0.08649819942881413 treat image : temp/1756427427_1339415_1377707114_91873131f70b118b497883b3966802c3.jpg resize: (1080, 1920) 1377707114 -1.0783625020644945 treat image : temp/1756427427_1339415_1377707101_a45e7334a26aff0e25d7f2823ac23f52.jpg resize: (1080, 1920) 1377707101 -2.1535534762010444 treat image : temp/1756427427_1339415_1377707088_3defef6b276becdbf1bac911d29216e4.jpg resize: (1080, 1920) 1377707088 -2.0033420479740487 treat image : temp/1756427427_1339415_1377707051_71242d5b480f1fe8f81d98aa1c16e12f.jpg resize: (1080, 1920) 1377707051 -2.6564751894916463 treat image : temp/1756427427_1339415_1377707049_bd1ac5acd4a20f4b02936bd1383a21f0.jpg resize: (1080, 1920) 1377707049 -2.2497873496401963 treat image : temp/1756427427_1339415_1377707047_e5e4ed5186801e3190dfa4952d2fd376.jpg resize: (1080, 1920) 1377707047 -1.5314802967021837 treat image : temp/1756427427_1339415_1377707045_3414c284f9412a84463fc090a2477e4a.jpg resize: (1080, 1920) 1377707045 -1.6076251000788688 treat image : temp/1756427427_1339415_1377707043_bf3d400aeb174456977cdc339d2adee1.jpg resize: (1080, 1920) 1377707043 -0.9075031503759848 treat image : temp/1756427427_1339415_1377707029_f5d6a0daafaf115607d598b49513445b.jpg resize: (1080, 1920) 1377707029 -1.9901606525882276 treat image : temp/1756427427_1339415_1377706973_6ff3d5cb8cc7edb02d1eb857f5e80720.jpg resize: (1080, 1920) 1377706973 -1.5825808421945189 treat image : temp/1756427427_1339415_1377707272_0cfe6985abaa484338ef3afcd475d6ee_rle_crop_3934912689_0.png resize: (117, 112) 1380018042 -2.369175051698561 treat image : temp/1756427427_1339415_1377707272_0cfe6985abaa484338ef3afcd475d6ee_rle_crop_3934912694_0.png resize: (36, 43) 1380018043 20.0 treat image : temp/1756427427_1339415_1377707267_ef5db760682f2097294bee0a278f86b3_rle_crop_3934912697_0.png resize: (75, 132) 1380018044 0.5540474378751266 treat image : temp/1756427427_1339415_1377707263_cb1f51363530402d74979aebe45de4d4_rle_crop_3934912704_0.png resize: (75, 83) 1380018045 -0.3290941154104244 treat image : temp/1756427427_1339415_1377707209_7e090351a911d65257fe5e51d1cc195a_rle_crop_3934912705_0.png resize: (188, 115) 1380018046 -0.7405614312149803 treat image : temp/1756427427_1339415_1377707208_6f9e89d3b080067e1f50b2c9e159d48d_rle_crop_3934912711_0.png resize: (71, 74) 1380018047 -2.9951248249146936 treat image : temp/1756427427_1339415_1377707208_6f9e89d3b080067e1f50b2c9e159d48d_rle_crop_3934912712_0.png resize: (59, 59) 1380018048 -3.0794699159995957 treat image : temp/1756427427_1339415_1377707208_6f9e89d3b080067e1f50b2c9e159d48d_rle_crop_3934912713_0.png resize: (120, 80) 1380018049 -1.655517865998015 treat image : temp/1756427427_1339415_1377707206_bf4939c1d03213dac5c06b36286e956f_rle_crop_3934912720_0.png resize: (193, 123) 1380018050 -0.5860463946413922 treat image : temp/1756427427_1339415_1377707206_bf4939c1d03213dac5c06b36286e956f_rle_crop_3934912721_0.png resize: (115, 60) 1380018051 -1.9545013636987576 treat image : temp/1756427427_1339415_1377707199_17733fc4116b5bf188e6340d7d21263c_rle_crop_3934912728_0.png resize: (127, 72) 1380018052 0.008395037678137809 treat image : temp/1756427427_1339415_1377707199_17733fc4116b5bf188e6340d7d21263c_rle_crop_3934912729_0.png resize: (109, 68) 1380018053 -1.2776314213773274 treat image : temp/1756427427_1339415_1377707183_4b1f67e46c3235c1eda0eb0869f46e9b_rle_crop_3934912730_0.png resize: (102, 99) 1380018054 -2.4849093150616963 treat image : temp/1756427427_1339415_1377707183_4b1f67e46c3235c1eda0eb0869f46e9b_rle_crop_3934912731_0.png resize: (106, 87) 1380018055 -3.292435041619691 treat image : temp/1756427427_1339415_1377707175_269d94a218e6e1563c72ca459801a457_rle_crop_3934912735_0.png resize: (170, 112) 1380018056 -0.5529683517195019 treat image : temp/1756427427_1339415_1377707167_ec4947608b1dafc0a856b660912c78c7_rle_crop_3934912739_0.png resize: (62, 50) 1380018057 4.353684951635384 treat image : temp/1756427427_1339415_1377707167_ec4947608b1dafc0a856b660912c78c7_rle_crop_3934912740_0.png resize: (127, 97) 1380018058 -1.55724925037526 treat image : temp/1756427427_1339415_1377707167_ec4947608b1dafc0a856b660912c78c7_rle_crop_3934912742_0.png resize: (119, 121) 1380018059 -3.345536354492489 treat image : temp/1756427427_1339415_1377707139_e1090e067fe03fe5e17e93646fcc627d_rle_crop_3934912748_0.png resize: (180, 105) 1380018060 -0.5414639277206561 treat image : temp/1756427427_1339415_1377707139_e1090e067fe03fe5e17e93646fcc627d_rle_crop_3934912750_0.png resize: (55, 90) 1380018061 8.05136243517761 treat image : temp/1756427427_1339415_1377707130_e59f20f49171c3bdb0c91c770a68ee6e_rle_crop_3934912753_0.png resize: (170, 108) 1380018062 -0.6955696681930195 treat image : temp/1756427427_1339415_1377707127_b2e0372c6331c02f11c8b5635660af41_rle_crop_3934912760_0.png resize: (171, 109) 1380018063 -2.01183866041223 treat image : temp/1756427427_1339415_1377707127_b2e0372c6331c02f11c8b5635660af41_rle_crop_3934912761_0.png resize: (178, 97) 1380018064 -1.4688304291545802 treat image : temp/1756427427_1339415_1377707123_52b9ba63765d6fb0a1129a1463af7b4f_rle_crop_3934912762_0.png resize: (184, 118) 1380018065 -0.4162180670776793 treat image : temp/1756427427_1339415_1377707114_91873131f70b118b497883b3966802c3_rle_crop_3934912763_0.png resize: (190, 72) 1380018066 -1.841217173192539 treat image : temp/1756427427_1339415_1377707114_91873131f70b118b497883b3966802c3_rle_crop_3934912764_0.png resize: (181, 116) 1380018067 -0.7030443679970543 treat image : temp/1756427427_1339415_1377707101_a45e7334a26aff0e25d7f2823ac23f52_rle_crop_3934912766_0.png resize: (149, 138) 1380018068 -2.0119705301879462 treat image : temp/1756427427_1339415_1377707101_a45e7334a26aff0e25d7f2823ac23f52_rle_crop_3934912768_0.png resize: (176, 124) 1380018069 -2.9563200539616 treat image : temp/1756427427_1339415_1377707101_a45e7334a26aff0e25d7f2823ac23f52_rle_crop_3934912769_0.png resize: (32, 37) 1380018070 -1.0778870380421617 treat image : temp/1756427427_1339415_1377707101_a45e7334a26aff0e25d7f2823ac23f52_rle_crop_3934912770_0.png resize: (70, 126) 1380018071 -1.3225762019885126 treat image : temp/1756427427_1339415_1377707088_3defef6b276becdbf1bac911d29216e4_rle_crop_3934912773_0.png resize: (101, 116) 1380018072 -2.299197196038424 treat image : temp/1756427427_1339415_1377707088_3defef6b276becdbf1bac911d29216e4_rle_crop_3934912774_0.png resize: (85, 118) 1380018073 -2.410082816130612 treat image : temp/1756427427_1339415_1377707049_bd1ac5acd4a20f4b02936bd1383a21f0_rle_crop_3934912777_0.png resize: (71, 165) 1380018074 1.0507907155388598 treat image : temp/1756427427_1339415_1377707049_bd1ac5acd4a20f4b02936bd1383a21f0_rle_crop_3934912778_0.png resize: (329, 119) 1380018075 -3.044125444692529 treat image : temp/1756427427_1339415_1377707049_bd1ac5acd4a20f4b02936bd1383a21f0_rle_crop_3934912781_0.png resize: (47, 78) 1380018076 -0.2731221438268883 treat image : temp/1756427427_1339415_1377707049_bd1ac5acd4a20f4b02936bd1383a21f0_rle_crop_3934912782_0.png resize: (124, 105) 1380018077 -1.3299289608385643 treat image : temp/1756427427_1339415_1377707045_3414c284f9412a84463fc090a2477e4a_rle_crop_3934912785_0.png resize: (56, 55) 1380018078 2.3417215860722473 treat image : temp/1756427427_1339415_1377707029_f5d6a0daafaf115607d598b49513445b_rle_crop_3934912790_0.png resize: (97, 107) 1380018079 -2.0493689984169277 treat image : temp/1756427427_1339415_1377707029_f5d6a0daafaf115607d598b49513445b_rle_crop_3934912793_0.png resize: (166, 108) 1380018080 -0.6555824444375942 treat image : temp/1756427427_1339415_1377707267_ef5db760682f2097294bee0a278f86b3_rle_crop_3934912698_0.png resize: (74, 97) 1380018086 -1.548461220901741 treat image : temp/1756427427_1339415_1377707203_4fdb9f49cde75185f3d7b79613e0d5fc_rle_crop_3934912725_0.png resize: (119, 135) 1380018087 -1.6071722811384679 treat image : temp/1756427427_1339415_1377707139_e1090e067fe03fe5e17e93646fcc627d_rle_crop_3934912747_0.png resize: (129, 109) 1380018088 -1.975182446809297 treat image : temp/1756427427_1339415_1377707130_e59f20f49171c3bdb0c91c770a68ee6e_rle_crop_3934912754_0.png resize: (128, 106) 1380018089 -0.518750275385254 treat image : temp/1756427427_1339415_1377707045_3414c284f9412a84463fc090a2477e4a_rle_crop_3934912784_0.png resize: (161, 198) 1380018090 -0.4608155662087114 treat image : temp/1756427427_1339415_1377707208_6f9e89d3b080067e1f50b2c9e159d48d_rle_crop_3934912715_0.png resize: (67, 151) 1380018091 -3.083309835386603 treat image : temp/1756427427_1339415_1377707272_0cfe6985abaa484338ef3afcd475d6ee_rle_crop_3934912690_0.png resize: (486, 316) 1380018098 -0.23327519728468563 treat image : temp/1756427427_1339415_1377707272_0cfe6985abaa484338ef3afcd475d6ee_rle_crop_3934912692_0.png resize: (139, 98) 1380018099 -2.137148400285541 treat image : temp/1756427427_1339415_1377707267_ef5db760682f2097294bee0a278f86b3_rle_crop_3934912695_0.png resize: (512, 342) 1380018100 -0.1691565476332489 treat image : temp/1756427427_1339415_1377707267_ef5db760682f2097294bee0a278f86b3_rle_crop_3934912696_0.png resize: (110, 161) 1380018101 -3.616324458351287 treat image : temp/1756427427_1339415_1377707267_ef5db760682f2097294bee0a278f86b3_rle_crop_3934912700_0.png resize: (75, 112) 1380018102 -0.8824369774119697 treat image : temp/1756427427_1339415_1377707263_cb1f51363530402d74979aebe45de4d4_rle_crop_3934912701_0.png resize: (489, 337) 1380018103 -0.2994656691722123 treat image : temp/1756427427_1339415_1377707263_cb1f51363530402d74979aebe45de4d4_rle_crop_3934912702_0.png resize: (140, 76) 1380018104 -4.051584054454976 treat image : temp/1756427427_1339415_1377707263_cb1f51363530402d74979aebe45de4d4_rle_crop_3934912703_0.png resize: (242, 295) 1380018105 -1.4682390634347229 treat image : temp/1756427427_1339415_1377707209_7e090351a911d65257fe5e51d1cc195a_rle_crop_3934912706_0.png resize: (990, 1070) 1380018106 -0.1773490950366992 treat image : temp/1756427427_1339415_1377707207_2568a89df09cdb811b468e040a884a40_rle_crop_3934912716_0.png resize: (505, 342) 1380018107 -0.25498001958779726 treat image : temp/1756427427_1339415_1377707207_2568a89df09cdb811b468e040a884a40_rle_crop_3934912717_0.png resize: (305, 148) 1380018108 -2.9793469995034267 treat image : temp/1756427427_1339415_1377707207_2568a89df09cdb811b468e040a884a40_rle_crop_3934912718_0.png resize: (160, 66) 1380018109 0.028526701835516453 treat image : temp/1756427427_1339415_1377707203_4fdb9f49cde75185f3d7b79613e0d5fc_rle_crop_3934912722_0.png resize: (155, 129) 1380018110 -1.1533918473235838 treat image : temp/1756427427_1339415_1377707203_4fdb9f49cde75185f3d7b79613e0d5fc_rle_crop_3934912724_0.png resize: (467, 353) 1380018111 -0.5149777196435685 treat image : temp/1756427427_1339415_1377707203_4fdb9f49cde75185f3d7b79613e0d5fc_rle_crop_3934912726_0.png resize: (224, 100) 1380018112 -1.2575844171964548 treat image : temp/1756427427_1339415_1377707183_4b1f67e46c3235c1eda0eb0869f46e9b_rle_crop_3934912732_0.png resize: (301, 226) 1380018113 -1.6538769114303482 treat image : temp/1756427427_1339415_1377707175_269d94a218e6e1563c72ca459801a457_rle_crop_3934912733_0.png resize: (504, 346) 1380018114 0.14669641087254792 treat image : temp/1756427427_1339415_1377707167_ec4947608b1dafc0a856b660912c78c7_rle_crop_3934912737_0.png resize: (150, 136) 1380018115 -3.57618424096835 treat image : temp/1756427427_1339415_1377707167_ec4947608b1dafc0a856b660912c78c7_rle_crop_3934912738_0.png resize: (145, 79) 1380018116 -5.176061353919845 treat image : temp/1756427427_1339415_1377707167_ec4947608b1dafc0a856b660912c78c7_rle_crop_3934912741_0.png resize: (908, 947) 1380018117 0.406347184168131 treat image : temp/1756427427_1339415_1377707160_a6e68b12faa966f8929850dd95477d93_rle_crop_3934912743_0.png resize: (496, 302) 1380018118 0.11366861078510788 treat image : temp/1756427427_1339415_1377707142_06138e3da9de0bc8b08f70f29708549d_rle_crop_3934912744_0.png resize: (122, 202) 1380018119 -2.266150378027714 treat image : temp/1756427427_1339415_1377707142_06138e3da9de0bc8b08f70f29708549d_rle_crop_3934912745_0.png resize: (67, 142) 1380018120 -2.062682667957023 treat image : temp/1756427427_1339415_1377707142_06138e3da9de0bc8b08f70f29708549d_rle_crop_3934912746_0.png resize: (218, 247) 1380018121 -3.1394872248352166 treat image : temp/1756427427_1339415_1377707139_e1090e067fe03fe5e17e93646fcc627d_rle_crop_3934912749_0.png resize: (177, 103) 1380018122 -1.7424941404670204 treat image : temp/1756427427_1339415_1377707139_e1090e067fe03fe5e17e93646fcc627d_rle_crop_3934912751_0.png resize: (512, 355) 1380018123 -0.18537003302995628 treat image : temp/1756427427_1339415_1377707139_e1090e067fe03fe5e17e93646fcc627d_rle_crop_3934912752_0.png resize: (951, 1024) 1380018124 0.3395031323780764 treat image : temp/1756427427_1339415_1377707130_e59f20f49171c3bdb0c91c770a68ee6e_rle_crop_3934912755_0.png resize: (189, 80) 1380018125 -0.9862063407742623 treat image : temp/1756427427_1339415_1377707130_e59f20f49171c3bdb0c91c770a68ee6e_rle_crop_3934912756_0.png resize: (240, 174) 1380018126 -1.2060967150641337 treat image : temp/1756427427_1339415_1377707130_e59f20f49171c3bdb0c91c770a68ee6e_rle_crop_3934912757_0.png resize: (138, 105) 1380018127 -1.6050542536723031 treat image : temp/1756427427_1339415_1377707130_e59f20f49171c3bdb0c91c770a68ee6e_rle_crop_3934912758_0.png resize: (1000, 1162) 1380018128 -1.9790836947159445 treat image : temp/1756427427_1339415_1377707127_b2e0372c6331c02f11c8b5635660af41_rle_crop_3934912759_0.png resize: (479, 327) 1380018129 -0.46708486737074184 treat image : temp/1756427427_1339415_1377707114_91873131f70b118b497883b3966802c3_rle_crop_3934912765_0.png resize: (143, 84) 1380018130 -0.29250174948531577 treat image : temp/1756427427_1339415_1377707088_3defef6b276becdbf1bac911d29216e4_rle_crop_3934912771_0.png resize: (201, 167) 1380018131 -2.487861354716799 treat image : temp/1756427427_1339415_1377707051_71242d5b480f1fe8f81d98aa1c16e12f_rle_crop_3934912775_0.png resize: (189, 105) 1380018132 -1.9158694251566373 treat image : temp/1756427427_1339415_1377707051_71242d5b480f1fe8f81d98aa1c16e12f_rle_crop_3934912776_0.png resize: (491, 342) 1380018133 -0.6698261212627071 treat image : temp/1756427427_1339415_1377707049_bd1ac5acd4a20f4b02936bd1383a21f0_rle_crop_3934912779_0.png resize: (131, 85) 1380018134 -2.7661686376088723 treat image : temp/1756427427_1339415_1377707049_bd1ac5acd4a20f4b02936bd1383a21f0_rle_crop_3934912780_0.png resize: (120, 111) 1380018135 -0.5932868749149818 treat image : temp/1756427427_1339415_1377707047_e5e4ed5186801e3190dfa4952d2fd376_rle_crop_3934912783_0.png resize: (70, 124) 1380018136 -2.8972330183362254 treat image : temp/1756427427_1339415_1377707043_bf3d400aeb174456977cdc339d2adee1_rle_crop_3934912788_0.png resize: (57, 78) 1380018137 1.7644468987713933 treat image : temp/1756427427_1339415_1377707029_f5d6a0daafaf115607d598b49513445b_rle_crop_3934912789_0.png resize: (521, 334) 1380018138 0.10799842029509377 treat image : temp/1756427427_1339415_1377707029_f5d6a0daafaf115607d598b49513445b_rle_crop_3934912791_0.png resize: (88, 158) 1380018139 -2.2720841750885756 treat image : temp/1756427427_1339415_1377707029_f5d6a0daafaf115607d598b49513445b_rle_crop_3934912795_0.png resize: (113, 141) 1380018140 -3.5054547034969983 treat image : temp/1756427427_1339415_1377706973_6ff3d5cb8cc7edb02d1eb857f5e80720_rle_crop_3934912796_0.png resize: (293, 238) 1380018141 -1.57134483544371 treat image : temp/1756427427_1339415_1377707272_0cfe6985abaa484338ef3afcd475d6ee_rle_crop_3934912691_0.png resize: (87, 80) 1380018142 -3.037840547254794 treat image : temp/1756427427_1339415_1377707272_0cfe6985abaa484338ef3afcd475d6ee_rle_crop_3934912693_0.png resize: (69, 162) 1380018143 0.5044295570066704 treat image : temp/1756427427_1339415_1377707267_ef5db760682f2097294bee0a278f86b3_rle_crop_3934912699_0.png resize: (106, 82) 1380018144 -1.2061532205318455 treat image : temp/1756427427_1339415_1377707209_7e090351a911d65257fe5e51d1cc195a_rle_crop_3934912707_0.png resize: (52, 66) 1380018145 -1.7004472365730217 treat image : temp/1756427427_1339415_1377707208_6f9e89d3b080067e1f50b2c9e159d48d_rle_crop_3934912708_0.png resize: (107, 107) 1380018146 -4.6337232435830735 treat image : temp/1756427427_1339415_1377707208_6f9e89d3b080067e1f50b2c9e159d48d_rle_crop_3934912709_0.png resize: (53, 52) 1380018147 -3.0941755526761057 treat image : temp/1756427427_1339415_1377707208_6f9e89d3b080067e1f50b2c9e159d48d_rle_crop_3934912710_0.png resize: (84, 73) 1380018148 -4.343982369096428 treat image : temp/1756427427_1339415_1377707208_6f9e89d3b080067e1f50b2c9e159d48d_rle_crop_3934912714_0.png resize: (39, 65) 1380018149 -3.870767463868845 treat image : temp/1756427427_1339415_1377707207_2568a89df09cdb811b468e040a884a40_rle_crop_3934912719_0.png resize: (64, 67) 1380018150 0.44379927291395743 treat image : temp/1756427427_1339415_1377707203_4fdb9f49cde75185f3d7b79613e0d5fc_rle_crop_3934912723_0.png resize: (52, 52) 1380018151 2.216657068482459 treat image : temp/1756427427_1339415_1377707203_4fdb9f49cde75185f3d7b79613e0d5fc_rle_crop_3934912727_0.png resize: (75, 88) 1380018152 -4.425971068970332 treat image : temp/1756427427_1339415_1377707175_269d94a218e6e1563c72ca459801a457_rle_crop_3934912734_0.png resize: (52, 75) 1380018153 -1.0016621438180586 treat image : temp/1756427427_1339415_1377707175_269d94a218e6e1563c72ca459801a457_rle_crop_3934912736_0.png resize: (59, 103) 1380018154 -2.0438057654852435 treat image : temp/1756427427_1339415_1377707101_a45e7334a26aff0e25d7f2823ac23f52_rle_crop_3934912767_0.png resize: (49, 55) 1380018155 -0.7290398145022445 treat image : temp/1756427427_1339415_1377707088_3defef6b276becdbf1bac911d29216e4_rle_crop_3934912772_0.png resize: (71, 78) 1380018156 -1.5844432826255452 treat image : temp/1756427427_1339415_1377707045_3414c284f9412a84463fc090a2477e4a_rle_crop_3934912786_0.png resize: (58, 79) 1380018157 -1.7794656381164338 treat image : temp/1756427427_1339415_1377707043_bf3d400aeb174456977cdc339d2adee1_rle_crop_3934912787_0.png resize: (106, 102) 1380018158 -2.4216732079096848 treat image : temp/1756427427_1339415_1377707029_f5d6a0daafaf115607d598b49513445b_rle_crop_3934912794_0.png resize: (104, 104) 1380018159 -0.5392678560385783 treat image : temp/1756427427_1339415_1377707029_f5d6a0daafaf115607d598b49513445b_rle_crop_3934912792_0.png resize: (108, 113) 1380018160 -3.1262831830307474 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 136 time used for this insertion : 0.024756431579589844 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 136 time used for this insertion : 0.03761124610900879 save missing photos in datou_result : time spend for datou_step_exec : 24.208083391189575 time spend to save output : 0.06751036643981934 total time spend for step 6 : 24.275593757629395 step7:brightness Fri Aug 29 02:32:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1756427427_1339415_1377707272_0cfe6985abaa484338ef3afcd475d6ee.jpg treat image : temp/1756427427_1339415_1377707267_ef5db760682f2097294bee0a278f86b3.jpg treat image : temp/1756427427_1339415_1377707263_cb1f51363530402d74979aebe45de4d4.jpg treat image : temp/1756427427_1339415_1377707209_7e090351a911d65257fe5e51d1cc195a.jpg treat image : temp/1756427427_1339415_1377707208_6f9e89d3b080067e1f50b2c9e159d48d.jpg treat image : temp/1756427427_1339415_1377707207_2568a89df09cdb811b468e040a884a40.jpg treat image : temp/1756427427_1339415_1377707206_bf4939c1d03213dac5c06b36286e956f.jpg treat image : temp/1756427427_1339415_1377707203_4fdb9f49cde75185f3d7b79613e0d5fc.jpg treat image : temp/1756427427_1339415_1377707199_17733fc4116b5bf188e6340d7d21263c.jpg treat image : temp/1756427427_1339415_1377707183_4b1f67e46c3235c1eda0eb0869f46e9b.jpg treat image : temp/1756427427_1339415_1377707175_269d94a218e6e1563c72ca459801a457.jpg treat image : temp/1756427427_1339415_1377707167_ec4947608b1dafc0a856b660912c78c7.jpg treat image : temp/1756427427_1339415_1377707160_a6e68b12faa966f8929850dd95477d93.jpg treat image : temp/1756427427_1339415_1377707142_06138e3da9de0bc8b08f70f29708549d.jpg treat image : temp/1756427427_1339415_1377707139_e1090e067fe03fe5e17e93646fcc627d.jpg treat image : temp/1756427427_1339415_1377707130_e59f20f49171c3bdb0c91c770a68ee6e.jpg treat image : temp/1756427427_1339415_1377707127_b2e0372c6331c02f11c8b5635660af41.jpg treat image : temp/1756427427_1339415_1377707123_52b9ba63765d6fb0a1129a1463af7b4f.jpg treat image : temp/1756427427_1339415_1377707114_91873131f70b118b497883b3966802c3.jpg treat image : temp/1756427427_1339415_1377707101_a45e7334a26aff0e25d7f2823ac23f52.jpg treat image : temp/1756427427_1339415_1377707088_3defef6b276becdbf1bac911d29216e4.jpg treat image : temp/1756427427_1339415_1377707051_71242d5b480f1fe8f81d98aa1c16e12f.jpg treat image : temp/1756427427_1339415_1377707049_bd1ac5acd4a20f4b02936bd1383a21f0.jpg treat image : temp/1756427427_1339415_1377707047_e5e4ed5186801e3190dfa4952d2fd376.jpg treat image : temp/1756427427_1339415_1377707045_3414c284f9412a84463fc090a2477e4a.jpg treat image : temp/1756427427_1339415_1377707043_bf3d400aeb174456977cdc339d2adee1.jpg treat image : temp/1756427427_1339415_1377707029_f5d6a0daafaf115607d598b49513445b.jpg treat image : temp/1756427427_1339415_1377706973_6ff3d5cb8cc7edb02d1eb857f5e80720.jpg treat image : temp/1756427427_1339415_1377707272_0cfe6985abaa484338ef3afcd475d6ee_rle_crop_3934912689_0.png treat image : temp/1756427427_1339415_1377707272_0cfe6985abaa484338ef3afcd475d6ee_rle_crop_3934912694_0.png treat image : temp/1756427427_1339415_1377707267_ef5db760682f2097294bee0a278f86b3_rle_crop_3934912697_0.png treat image : temp/1756427427_1339415_1377707263_cb1f51363530402d74979aebe45de4d4_rle_crop_3934912704_0.png treat image : temp/1756427427_1339415_1377707209_7e090351a911d65257fe5e51d1cc195a_rle_crop_3934912705_0.png treat image : temp/1756427427_1339415_1377707208_6f9e89d3b080067e1f50b2c9e159d48d_rle_crop_3934912711_0.png treat image : temp/1756427427_1339415_1377707208_6f9e89d3b080067e1f50b2c9e159d48d_rle_crop_3934912712_0.png treat image : temp/1756427427_1339415_1377707208_6f9e89d3b080067e1f50b2c9e159d48d_rle_crop_3934912713_0.png treat image : temp/1756427427_1339415_1377707206_bf4939c1d03213dac5c06b36286e956f_rle_crop_3934912720_0.png treat image : temp/1756427427_1339415_1377707206_bf4939c1d03213dac5c06b36286e956f_rle_crop_3934912721_0.png treat image : temp/1756427427_1339415_1377707199_17733fc4116b5bf188e6340d7d21263c_rle_crop_3934912728_0.png treat image : temp/1756427427_1339415_1377707199_17733fc4116b5bf188e6340d7d21263c_rle_crop_3934912729_0.png treat image : temp/1756427427_1339415_1377707183_4b1f67e46c3235c1eda0eb0869f46e9b_rle_crop_3934912730_0.png treat image : temp/1756427427_1339415_1377707183_4b1f67e46c3235c1eda0eb0869f46e9b_rle_crop_3934912731_0.png treat image : temp/1756427427_1339415_1377707175_269d94a218e6e1563c72ca459801a457_rle_crop_3934912735_0.png treat image : temp/1756427427_1339415_1377707167_ec4947608b1dafc0a856b660912c78c7_rle_crop_3934912739_0.png treat image : temp/1756427427_1339415_1377707167_ec4947608b1dafc0a856b660912c78c7_rle_crop_3934912740_0.png treat image : temp/1756427427_1339415_1377707167_ec4947608b1dafc0a856b660912c78c7_rle_crop_3934912742_0.png treat image : temp/1756427427_1339415_1377707139_e1090e067fe03fe5e17e93646fcc627d_rle_crop_3934912748_0.png treat image : temp/1756427427_1339415_1377707139_e1090e067fe03fe5e17e93646fcc627d_rle_crop_3934912750_0.png treat image : temp/1756427427_1339415_1377707130_e59f20f49171c3bdb0c91c770a68ee6e_rle_crop_3934912753_0.png treat image : temp/1756427427_1339415_1377707127_b2e0372c6331c02f11c8b5635660af41_rle_crop_3934912760_0.png treat image : temp/1756427427_1339415_1377707127_b2e0372c6331c02f11c8b5635660af41_rle_crop_3934912761_0.png treat image : temp/1756427427_1339415_1377707123_52b9ba63765d6fb0a1129a1463af7b4f_rle_crop_3934912762_0.png treat image : temp/1756427427_1339415_1377707114_91873131f70b118b497883b3966802c3_rle_crop_3934912763_0.png treat image : temp/1756427427_1339415_1377707114_91873131f70b118b497883b3966802c3_rle_crop_3934912764_0.png treat image : temp/1756427427_1339415_1377707101_a45e7334a26aff0e25d7f2823ac23f52_rle_crop_3934912766_0.png treat image : temp/1756427427_1339415_1377707101_a45e7334a26aff0e25d7f2823ac23f52_rle_crop_3934912768_0.png treat image : temp/1756427427_1339415_1377707101_a45e7334a26aff0e25d7f2823ac23f52_rle_crop_3934912769_0.png treat image : temp/1756427427_1339415_1377707101_a45e7334a26aff0e25d7f2823ac23f52_rle_crop_3934912770_0.png treat image : temp/1756427427_1339415_1377707088_3defef6b276becdbf1bac911d29216e4_rle_crop_3934912773_0.png treat image : temp/1756427427_1339415_1377707088_3defef6b276becdbf1bac911d29216e4_rle_crop_3934912774_0.png treat image : temp/1756427427_1339415_1377707049_bd1ac5acd4a20f4b02936bd1383a21f0_rle_crop_3934912777_0.png treat image : temp/1756427427_1339415_1377707049_bd1ac5acd4a20f4b02936bd1383a21f0_rle_crop_3934912778_0.png treat image : temp/1756427427_1339415_1377707049_bd1ac5acd4a20f4b02936bd1383a21f0_rle_crop_3934912781_0.png treat image : temp/1756427427_1339415_1377707049_bd1ac5acd4a20f4b02936bd1383a21f0_rle_crop_3934912782_0.png treat image : temp/1756427427_1339415_1377707045_3414c284f9412a84463fc090a2477e4a_rle_crop_3934912785_0.png treat image : temp/1756427427_1339415_1377707029_f5d6a0daafaf115607d598b49513445b_rle_crop_3934912790_0.png treat image : temp/1756427427_1339415_1377707029_f5d6a0daafaf115607d598b49513445b_rle_crop_3934912793_0.png treat image : temp/1756427427_1339415_1377707267_ef5db760682f2097294bee0a278f86b3_rle_crop_3934912698_0.png treat image : temp/1756427427_1339415_1377707203_4fdb9f49cde75185f3d7b79613e0d5fc_rle_crop_3934912725_0.png treat image : temp/1756427427_1339415_1377707139_e1090e067fe03fe5e17e93646fcc627d_rle_crop_3934912747_0.png treat image : temp/1756427427_1339415_1377707130_e59f20f49171c3bdb0c91c770a68ee6e_rle_crop_3934912754_0.png treat image : temp/1756427427_1339415_1377707045_3414c284f9412a84463fc090a2477e4a_rle_crop_3934912784_0.png treat image : temp/1756427427_1339415_1377707208_6f9e89d3b080067e1f50b2c9e159d48d_rle_crop_3934912715_0.png treat image : temp/1756427427_1339415_1377707272_0cfe6985abaa484338ef3afcd475d6ee_rle_crop_3934912690_0.png treat image : temp/1756427427_1339415_1377707272_0cfe6985abaa484338ef3afcd475d6ee_rle_crop_3934912692_0.png treat image : temp/1756427427_1339415_1377707267_ef5db760682f2097294bee0a278f86b3_rle_crop_3934912695_0.png treat image : temp/1756427427_1339415_1377707267_ef5db760682f2097294bee0a278f86b3_rle_crop_3934912696_0.png treat image : temp/1756427427_1339415_1377707267_ef5db760682f2097294bee0a278f86b3_rle_crop_3934912700_0.png treat image : temp/1756427427_1339415_1377707263_cb1f51363530402d74979aebe45de4d4_rle_crop_3934912701_0.png treat image : temp/1756427427_1339415_1377707263_cb1f51363530402d74979aebe45de4d4_rle_crop_3934912702_0.png treat image : temp/1756427427_1339415_1377707263_cb1f51363530402d74979aebe45de4d4_rle_crop_3934912703_0.png treat image : temp/1756427427_1339415_1377707209_7e090351a911d65257fe5e51d1cc195a_rle_crop_3934912706_0.png treat image : temp/1756427427_1339415_1377707207_2568a89df09cdb811b468e040a884a40_rle_crop_3934912716_0.png treat image : temp/1756427427_1339415_1377707207_2568a89df09cdb811b468e040a884a40_rle_crop_3934912717_0.png treat image : temp/1756427427_1339415_1377707207_2568a89df09cdb811b468e040a884a40_rle_crop_3934912718_0.png treat image : temp/1756427427_1339415_1377707203_4fdb9f49cde75185f3d7b79613e0d5fc_rle_crop_3934912722_0.png treat image : temp/1756427427_1339415_1377707203_4fdb9f49cde75185f3d7b79613e0d5fc_rle_crop_3934912724_0.png treat image : temp/1756427427_1339415_1377707203_4fdb9f49cde75185f3d7b79613e0d5fc_rle_crop_3934912726_0.png treat image : temp/1756427427_1339415_1377707183_4b1f67e46c3235c1eda0eb0869f46e9b_rle_crop_3934912732_0.png treat image : temp/1756427427_1339415_1377707175_269d94a218e6e1563c72ca459801a457_rle_crop_3934912733_0.png treat image : temp/1756427427_1339415_1377707167_ec4947608b1dafc0a856b660912c78c7_rle_crop_3934912737_0.png treat image : temp/1756427427_1339415_1377707167_ec4947608b1dafc0a856b660912c78c7_rle_crop_3934912738_0.png treat image : temp/1756427427_1339415_1377707167_ec4947608b1dafc0a856b660912c78c7_rle_crop_3934912741_0.png treat image : temp/1756427427_1339415_1377707160_a6e68b12faa966f8929850dd95477d93_rle_crop_3934912743_0.png treat image : temp/1756427427_1339415_1377707142_06138e3da9de0bc8b08f70f29708549d_rle_crop_3934912744_0.png treat image : temp/1756427427_1339415_1377707142_06138e3da9de0bc8b08f70f29708549d_rle_crop_3934912745_0.png treat image : temp/1756427427_1339415_1377707142_06138e3da9de0bc8b08f70f29708549d_rle_crop_3934912746_0.png treat image : temp/1756427427_1339415_1377707139_e1090e067fe03fe5e17e93646fcc627d_rle_crop_3934912749_0.png treat image : temp/1756427427_1339415_1377707139_e1090e067fe03fe5e17e93646fcc627d_rle_crop_3934912751_0.png treat image : temp/1756427427_1339415_1377707139_e1090e067fe03fe5e17e93646fcc627d_rle_crop_3934912752_0.png treat image : temp/1756427427_1339415_1377707130_e59f20f49171c3bdb0c91c770a68ee6e_rle_crop_3934912755_0.png treat image : temp/1756427427_1339415_1377707130_e59f20f49171c3bdb0c91c770a68ee6e_rle_crop_3934912756_0.png treat image : temp/1756427427_1339415_1377707130_e59f20f49171c3bdb0c91c770a68ee6e_rle_crop_3934912757_0.png treat image : temp/1756427427_1339415_1377707130_e59f20f49171c3bdb0c91c770a68ee6e_rle_crop_3934912758_0.png treat image : temp/1756427427_1339415_1377707127_b2e0372c6331c02f11c8b5635660af41_rle_crop_3934912759_0.png treat image : temp/1756427427_1339415_1377707114_91873131f70b118b497883b3966802c3_rle_crop_3934912765_0.png treat image : temp/1756427427_1339415_1377707088_3defef6b276becdbf1bac911d29216e4_rle_crop_3934912771_0.png treat image : temp/1756427427_1339415_1377707051_71242d5b480f1fe8f81d98aa1c16e12f_rle_crop_3934912775_0.png treat image : temp/1756427427_1339415_1377707051_71242d5b480f1fe8f81d98aa1c16e12f_rle_crop_3934912776_0.png treat image : temp/1756427427_1339415_1377707049_bd1ac5acd4a20f4b02936bd1383a21f0_rle_crop_3934912779_0.png treat image : temp/1756427427_1339415_1377707049_bd1ac5acd4a20f4b02936bd1383a21f0_rle_crop_3934912780_0.png treat image : temp/1756427427_1339415_1377707047_e5e4ed5186801e3190dfa4952d2fd376_rle_crop_3934912783_0.png treat image : temp/1756427427_1339415_1377707043_bf3d400aeb174456977cdc339d2adee1_rle_crop_3934912788_0.png treat image : temp/1756427427_1339415_1377707029_f5d6a0daafaf115607d598b49513445b_rle_crop_3934912789_0.png treat image : temp/1756427427_1339415_1377707029_f5d6a0daafaf115607d598b49513445b_rle_crop_3934912791_0.png treat image : temp/1756427427_1339415_1377707029_f5d6a0daafaf115607d598b49513445b_rle_crop_3934912795_0.png treat image : temp/1756427427_1339415_1377706973_6ff3d5cb8cc7edb02d1eb857f5e80720_rle_crop_3934912796_0.png treat image : temp/1756427427_1339415_1377707272_0cfe6985abaa484338ef3afcd475d6ee_rle_crop_3934912691_0.png treat image : temp/1756427427_1339415_1377707272_0cfe6985abaa484338ef3afcd475d6ee_rle_crop_3934912693_0.png treat image : temp/1756427427_1339415_1377707267_ef5db760682f2097294bee0a278f86b3_rle_crop_3934912699_0.png treat image : temp/1756427427_1339415_1377707209_7e090351a911d65257fe5e51d1cc195a_rle_crop_3934912707_0.png treat image : temp/1756427427_1339415_1377707208_6f9e89d3b080067e1f50b2c9e159d48d_rle_crop_3934912708_0.png treat image : temp/1756427427_1339415_1377707208_6f9e89d3b080067e1f50b2c9e159d48d_rle_crop_3934912709_0.png treat image : temp/1756427427_1339415_1377707208_6f9e89d3b080067e1f50b2c9e159d48d_rle_crop_3934912710_0.png treat image : temp/1756427427_1339415_1377707208_6f9e89d3b080067e1f50b2c9e159d48d_rle_crop_3934912714_0.png treat image : temp/1756427427_1339415_1377707207_2568a89df09cdb811b468e040a884a40_rle_crop_3934912719_0.png treat image : temp/1756427427_1339415_1377707203_4fdb9f49cde75185f3d7b79613e0d5fc_rle_crop_3934912723_0.png treat image : temp/1756427427_1339415_1377707203_4fdb9f49cde75185f3d7b79613e0d5fc_rle_crop_3934912727_0.png treat image : temp/1756427427_1339415_1377707175_269d94a218e6e1563c72ca459801a457_rle_crop_3934912734_0.png treat image : temp/1756427427_1339415_1377707175_269d94a218e6e1563c72ca459801a457_rle_crop_3934912736_0.png treat image : temp/1756427427_1339415_1377707101_a45e7334a26aff0e25d7f2823ac23f52_rle_crop_3934912767_0.png treat image : temp/1756427427_1339415_1377707088_3defef6b276becdbf1bac911d29216e4_rle_crop_3934912772_0.png treat image : temp/1756427427_1339415_1377707045_3414c284f9412a84463fc090a2477e4a_rle_crop_3934912786_0.png treat image : temp/1756427427_1339415_1377707043_bf3d400aeb174456977cdc339d2adee1_rle_crop_3934912787_0.png treat image : temp/1756427427_1339415_1377707029_f5d6a0daafaf115607d598b49513445b_rle_crop_3934912794_0.png treat image : temp/1756427427_1339415_1377707029_f5d6a0daafaf115607d598b49513445b_rle_crop_3934912792_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 136 time used for this insertion : 0.020802021026611328 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 136 time used for this insertion : 0.03283047676086426 save missing photos in datou_result : time spend for datou_step_exec : 6.789868354797363 time spend to save output : 0.05927276611328125 total time spend for step 7 : 6.8491411209106445 step8:velours_tree Fri Aug 29 02:32:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.09662580490112305 time spend to save output : 4.5299530029296875e-05 total time spend for step 8 : 0.09667110443115234 step9:send_mail_cod Fri Aug 29 02:32:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26310890_29-08-2025_02_32_58.pdf 26313500 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette263135001756427578 26313501 change filename to text .imagette263135011756427579 26313502 imagette263135021756427579 26313504 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette263135041756427579 26313505 imagette263135051756427581 26313506 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette263135061756427581 26313507 change filename to text .imagette263135071756427581 26313508 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette263135081756427581 26313509 imagette263135091756427582 26313510 imagette263135101756427582 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26310890 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/26313500,26313501,26313502,26313503,26313504,26313505,26313506,26313507,26313508,26313509,26313510?tags=autre,pet_fonce,background,environnement,pet_clair,pehd,carton,metal,papier,flou,mal_croppe args[1377707272] : ((1377707272, -2.104801325281092, 492609224), (1377707272, 0.561491659658517, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com args[1377707267] : ((1377707267, -0.4194407748841918, 492688767), (1377707267, 0.478353985405811, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com args[1377707263] : ((1377707263, -2.0754444820217595, 492609224), (1377707263, 0.46100733489367846, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com args[1377707209] : ((1377707209, -2.085243784703612, 492609224), (1377707209, 0.43973142119608294, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com args[1377707208] : ((1377707208, -3.903668385824852, 492609224), (1377707208, 0.4021074116134079, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com args[1377707207] : ((1377707207, -0.982880606708402, 492688767), (1377707207, 0.3962216315293817, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com args[1377707206] : ((1377707206, -1.9824925399828082, 492688767), (1377707206, 0.4224930241739557, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com args[1377707203] : ((1377707203, -2.2935273307488826, 492609224), (1377707203, 0.5405733764684649, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com args[1377707199] : ((1377707199, -1.8679951825298, 492688767), (1377707199, 0.4433372445475724, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com args[1377707183] : ((1377707183, -1.9849091638862424, 492688767), (1377707183, 0.3157792763348155, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com args[1377707175] : ((1377707175, -1.9796851457409652, 492688767), (1377707175, 0.43195412857489895, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com args[1377707167] : ((1377707167, -2.239929939956396, 492609224), (1377707167, 0.5085452218880737, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com args[1377707160] : ((1377707160, -2.2715276066778136, 492609224), (1377707160, 0.2849759937797031, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com args[1377707142] : ((1377707142, -2.112518585835347, 492609224), (1377707142, 0.47992057252704373, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com args[1377707139] : ((1377707139, -2.1894132202131176, 492609224), (1377707139, 0.41195537557648854, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com args[1377707130] : ((1377707130, -1.7859927284368395, 492688767), (1377707130, 0.431449095452197, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com args[1377707127] : ((1377707127, -1.1046266225593975, 492688767), (1377707127, 0.4054068442517719, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com args[1377707123] : ((1377707123, 0.08649819942881413, 492688767), (1377707123, 0.5978489052254723, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com args[1377707114] : ((1377707114, -1.0783625020644945, 492688767), (1377707114, 0.3941658918522661, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com args[1377707101] : ((1377707101, -2.1535534762010444, 492609224), (1377707101, 0.3801995410719037, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com args[1377707088] : ((1377707088, -2.0033420479740487, 492609224), (1377707088, 0.4144664461486186, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com args[1377707051] : ((1377707051, -2.6564751894916463, 492609224), (1377707051, 0.4680432929885315, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com args[1377707049] : ((1377707049, -2.2497873496401963, 492609224), (1377707049, 0.6485909538748793, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com args[1377707047] : ((1377707047, -1.5314802967021837, 492688767), (1377707047, 0.390300848788817, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com args[1377707045] : ((1377707045, -1.6076251000788688, 492688767), (1377707045, 0.5278626417191066, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com args[1377707043] : ((1377707043, -0.9075031503759848, 492688767), (1377707043, 0.5596201998881414, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com args[1377707029] : ((1377707029, -1.9901606525882276, 492688767), (1377707029, 0.47726152018609025, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com args[1377706973] : ((1377706973, -1.5825808421945189, 492688767), (1377706973, 0.49979899903556946, 2107752395), '0.08763685653659609') We are sending mail with results at report@fotonower.com refus_total : 0.08763685653659609 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26310890 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26310890_29-08-2025_02_32_58.pdf results_Auto_P26310890_29-08-2025_02_32_58.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26310890_29-08-2025_02_32_58.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26310890','results_Auto_P26310890_29-08-2025_02_32_58.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26310890_29-08-2025_02_32_58.pdf','pdf','','0.48','0.08763685653659609') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26310890

https://www.fotonower.com/image?json=false&list_photos_id=1377707272
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707267
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707263
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707209
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707208
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707207
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707206
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707203
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707199
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707183
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707175
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707167
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707160
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707142
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707139
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707130
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707127
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707123
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707114
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707101
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707088
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707051
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707049
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707047
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707045
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707043
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707029
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377706973
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 8.76%
Veuillez trouver les photos des contaminants.

exemples de contaminants: autre: https://www.fotonower.com/view/26313500?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/26313501?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26313504?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26313506?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/26313507?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26313508?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26310890_29-08-2025_02_32_58.pdf.

Lien vers velours :https://www.fotonower.com/velours/26313500,26313501,26313502,26313503,26313504,26313505,26313506,26313507,26313508,26313509,26313510?tags=autre,pet_fonce,background,environnement,pet_clair,pehd,carton,metal,papier,flou,mal_croppe.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 29 Aug 2025 00:33:04 GMT Content-Length: 0 Connection: close X-Message-Id: LYqWGosnQLOMgmqHLSj_xw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1377707272, 1377707267, 1377707263, 1377707209, 1377707208, 1377707207, 1377707206, 1377707203, 1377707199, 1377707183, 1377707175, 1377707167, 1377707160, 1377707142, 1377707139, 1377707130, 1377707127, 1377707123, 1377707114, 1377707101, 1377707088, 1377707051, 1377707049, 1377707047, 1377707045, 1377707043, 1377707029, 1377706973] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707272', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707267', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707263', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707209', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707208', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707207', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707206', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707203', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707199', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707183', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707175', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707167', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707160', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707142', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707139', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707130', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707127', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707123', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707114', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707101', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707088', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707051', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707049', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707047', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707045', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707043', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707029', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377706973', None, None, None, None, None, '3629923') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 28 time used for this insertion : 0.01792311668395996 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.295671463012695 time spend to save output : 0.018231630325317383 total time spend for step 9 : 6.313903093338013 step10:split_time_score Fri Aug 29 02:33:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 28),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 18082025 26310890 Nombre de photos uploadées : 28 / 23040 (0%) 18082025 26310890 Nombre de photos taguées (types de déchets): 0 / 28 (0%) 18082025 26310890 Nombre de photos taguées (volume) : 0 / 28 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ???????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0012264251708984375 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.20329833030700684 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310847 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310850 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310854 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310857 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310862 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310866 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310868 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310871 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310873 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310881 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310883 order by id desc limit 1 Qualite : 0.08763685653659609 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26310890_29-08-2025_02_32_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310890 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26310890 AND mptpi.`type`=3594 To do Qualite : 0.08801835317460316 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26310894_29-08-2025_02_22_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310894 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26310894 AND mptpi.`type`=3594 To do Qualite : 0.17703582308961255 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26310895_29-08-2025_00_43_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310895 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26310895 AND mptpi.`type`=3594 To do Qualite : 0.3151915147569445 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26310908_29-08-2025_00_32_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310908 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26310908 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'18082025': {'nb_upload': 28, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1377707272, 1377707267, 1377707263, 1377707209, 1377707208, 1377707207, 1377707206, 1377707203, 1377707199, 1377707183, 1377707175, 1377707167, 1377707160, 1377707142, 1377707139, 1377707130, 1377707127, 1377707123, 1377707114, 1377707101, 1377707088, 1377707051, 1377707049, 1377707047, 1377707045, 1377707043, 1377707029, 1377706973] Looping around the photos to save general results len do output : 1 /26310890Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707272', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707267', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707263', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707209', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707208', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707207', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707206', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707203', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707199', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707183', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707175', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707167', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707160', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707142', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707139', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707130', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707127', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707123', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707114', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707101', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707088', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707051', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707049', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707047', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707045', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707043', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377707029', None, None, None, None, None, '3629923') ('3318', None, None, None, None, None, None, None, '3629923') ('3318', '26310890', '1377706973', None, None, None, None, None, '3629923') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 29 time used for this insertion : 0.01751708984375 save_final save missing photos in datou_result : time spend for datou_step_exec : 11.270766258239746 time spend to save output : 0.017887353897094727 total time spend for step 10 : 11.28865361213684 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 28 set_done_treatment 90.06user 30.24system 2:50.79elapsed 70%CPU (0avgtext+0avgdata 3408668maxresident)k 1331488inputs+44080outputs (10993major+2644649minor)pagefaults 0swaps