python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2475663 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3929033'] with mtr_portfolio_ids : ['27729672'] and first list_photo_ids : [] new path : /proc/2475663/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 9 ; length of list_pids : 9 ; length of list_args : 9 time to download the photos : 2.0128164291381836 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Sat Oct 11 12:40:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3027 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-10-11 12:40:34.342616: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-10-11 12:40:34.374421: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-10-11 12:40:34.375986: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fd798000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-10-11 12:40:34.376036: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-10-11 12:40:34.378609: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-10-11 12:40:34.613962: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x18160440 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-10-11 12:40:34.614001: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-10-11 12:40:34.614742: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-11 12:40:34.615051: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-11 12:40:34.617096: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-11 12:40:34.625280: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-11 12:40:34.625593: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-11 12:40:34.628195: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-11 12:40:34.629180: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-11 12:40:34.639824: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-11 12:40:34.640832: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-11 12:40:34.640910: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-11 12:40:34.641442: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-11 12:40:34.641457: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-11 12:40:34.641466: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-11 12:40:34.642326: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2575 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-10-11 12:40:35.043577: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-11 12:40:35.043706: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-11 12:40:35.043743: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-11 12:40:35.043776: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-11 12:40:35.043809: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-11 12:40:35.043838: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-11 12:40:35.043866: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-11 12:40:35.043894: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-11 12:40:35.045007: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-11 12:40:35.046343: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-11 12:40:35.046419: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-11 12:40:35.046452: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-11 12:40:35.046479: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-11 12:40:35.046507: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-11 12:40:35.046538: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-11 12:40:35.046565: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-11 12:40:35.046594: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-11 12:40:35.047765: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-11 12:40:35.047805: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-11 12:40:35.047820: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-11 12:40:35.047834: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-11 12:40:35.049096: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2575 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-10-11 12:40:44.256660: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-11 12:40:44.470742: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-11 12:40:46.464903: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-11 12:40:46.464990: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-11 12:40:46.471529: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-11 12:40:46.471561: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-11 12:40:46.526840: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-11 12:40:46.526932: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-11 12:40:46.569682: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-11 12:40:46.569718: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-11 12:40:46.621943: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-11 12:40:46.622005: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-11 12:40:46.624514: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.52G (1628307456 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:46.625187: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.36G (1465476608 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:46.940912: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-10-11 12:40:46.984817: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:46.985910: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:46.987323: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:46.988197: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:46.998551: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:46.999338: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.000028: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.000609: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.001186: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.001813: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.016226: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.016851: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.050098: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.050141: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-10-11 12:40:47.050808: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.051451: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.058711: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.059486: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.067490: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.068089: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.088018: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.088800: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.089597: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.090409: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.094540: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.095188: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.095851: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.096437: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.098046: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.107580: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.108188: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.117241: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.117867: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.118514: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.119163: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.119806: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-11 12:40:47.120386: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 9 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 30 Detection mask done ! Trying to reset tf kernel 2476303 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1615 tf kernel not reseted sub process len(results) : 9 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 9 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2808 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0010097026824951172 nb_pixel_total : 34685 time to create 1 rle with old method : 0.037729501724243164 length of segment : 254 time for calcul the mask position with numpy : 0.0012392997741699219 nb_pixel_total : 64804 time to create 1 rle with old method : 0.06811904907226562 length of segment : 268 time for calcul the mask position with numpy : 0.0004010200500488281 nb_pixel_total : 21064 time to create 1 rle with old method : 0.022900819778442383 length of segment : 271 time for calcul the mask position with numpy : 0.0008535385131835938 nb_pixel_total : 60032 time to create 1 rle with old method : 0.06388449668884277 length of segment : 307 time for calcul the mask position with numpy : 0.0002980232238769531 nb_pixel_total : 16373 time to create 1 rle with old method : 0.017484426498413086 length of segment : 115 time for calcul the mask position with numpy : 0.0008990764617919922 nb_pixel_total : 65172 time to create 1 rle with old method : 0.06803441047668457 length of segment : 367 time for calcul the mask position with numpy : 0.006086826324462891 nb_pixel_total : 227777 time to create 1 rle with new method : 0.017886877059936523 length of segment : 519 time for calcul the mask position with numpy : 0.0010449886322021484 nb_pixel_total : 67013 time to create 1 rle with old method : 0.07132291793823242 length of segment : 436 time for calcul the mask position with numpy : 0.003904581069946289 nb_pixel_total : 193586 time to create 1 rle with new method : 0.01832413673400879 length of segment : 721 time for calcul the mask position with numpy : 0.002343893051147461 nb_pixel_total : 106454 time to create 1 rle with old method : 0.11034774780273438 length of segment : 617 time for calcul the mask position with numpy : 0.0004506111145019531 nb_pixel_total : 27215 time to create 1 rle with old method : 0.028596878051757812 length of segment : 148 time for calcul the mask position with numpy : 0.0005922317504882812 nb_pixel_total : 38772 time to create 1 rle with old method : 0.0413210391998291 length of segment : 205 time for calcul the mask position with numpy : 0.003069639205932617 nb_pixel_total : 156097 time to create 1 rle with new method : 0.012281179428100586 length of segment : 524 time for calcul the mask position with numpy : 0.0029168128967285156 nb_pixel_total : 135898 time to create 1 rle with old method : 0.1513967514038086 length of segment : 478 time for calcul the mask position with numpy : 0.0003993511199951172 nb_pixel_total : 24882 time to create 1 rle with old method : 0.02822709083557129 length of segment : 191 time for calcul the mask position with numpy : 0.0006387233734130859 nb_pixel_total : 34382 time to create 1 rle with old method : 0.040442466735839844 length of segment : 154 time for calcul the mask position with numpy : 0.0031185150146484375 nb_pixel_total : 176282 time to create 1 rle with new method : 0.011774063110351562 length of segment : 503 time for calcul the mask position with numpy : 0.0019526481628417969 nb_pixel_total : 106721 time to create 1 rle with old method : 0.1108250617980957 length of segment : 671 time for calcul the mask position with numpy : 0.0007908344268798828 nb_pixel_total : 43551 time to create 1 rle with old method : 0.046085357666015625 length of segment : 305 time for calcul the mask position with numpy : 0.003693103790283203 nb_pixel_total : 166472 time to create 1 rle with new method : 0.01642775535583496 length of segment : 777 time for calcul the mask position with numpy : 0.0012059211730957031 nb_pixel_total : 75239 time to create 1 rle with old method : 0.07879018783569336 length of segment : 275 time for calcul the mask position with numpy : 0.000995635986328125 nb_pixel_total : 56950 time to create 1 rle with old method : 0.06166863441467285 length of segment : 214 time for calcul the mask position with numpy : 0.002035856246948242 nb_pixel_total : 116606 time to create 1 rle with old method : 0.12777495384216309 length of segment : 529 time for calcul the mask position with numpy : 0.001779794692993164 nb_pixel_total : 103586 time to create 1 rle with old method : 0.10843920707702637 length of segment : 418 time for calcul the mask position with numpy : 0.0012111663818359375 nb_pixel_total : 67306 time to create 1 rle with old method : 0.07089424133300781 length of segment : 421 time for calcul the mask position with numpy : 0.0005681514739990234 nb_pixel_total : 30860 time to create 1 rle with old method : 0.034989356994628906 length of segment : 227 time for calcul the mask position with numpy : 0.0022194385528564453 nb_pixel_total : 106771 time to create 1 rle with old method : 0.11594915390014648 length of segment : 894 time for calcul the mask position with numpy : 0.0004832744598388672 nb_pixel_total : 16315 time to create 1 rle with old method : 0.017916440963745117 length of segment : 330 time for calcul the mask position with numpy : 0.00023102760314941406 nb_pixel_total : 9630 time to create 1 rle with old method : 0.01128244400024414 length of segment : 131 time for calcul the mask position with numpy : 0.006703853607177734 nb_pixel_total : 322688 time to create 1 rle with new method : 0.02057027816772461 length of segment : 807 time for calcul the mask position with numpy : 0.0002377033233642578 nb_pixel_total : 10248 time to create 1 rle with old method : 0.011502504348754883 length of segment : 109 time for calcul the mask position with numpy : 0.0006351470947265625 nb_pixel_total : 39273 time to create 1 rle with old method : 0.043317317962646484 length of segment : 209 time for calcul the mask position with numpy : 0.0007939338684082031 nb_pixel_total : 42915 time to create 1 rle with old method : 0.04612255096435547 length of segment : 249 time for calcul the mask position with numpy : 0.0024793148040771484 nb_pixel_total : 165019 time to create 1 rle with new method : 0.008375406265258789 length of segment : 511 time for calcul the mask position with numpy : 0.00018215179443359375 nb_pixel_total : 5599 time to create 1 rle with old method : 0.006044864654541016 length of segment : 78 time for calcul the mask position with numpy : 0.0003268718719482422 nb_pixel_total : 19206 time to create 1 rle with old method : 0.020732641220092773 length of segment : 149 time for calcul the mask position with numpy : 0.0008251667022705078 nb_pixel_total : 44159 time to create 1 rle with old method : 0.046872854232788086 length of segment : 211 time for calcul the mask position with numpy : 0.009470462799072266 nb_pixel_total : 497615 time to create 1 rle with new method : 0.02512216567993164 length of segment : 1165 time for calcul the mask position with numpy : 0.0010807514190673828 nb_pixel_total : 56250 time to create 1 rle with old method : 0.0598452091217041 length of segment : 750 time for calcul the mask position with numpy : 0.0014314651489257812 nb_pixel_total : 101743 time to create 1 rle with old method : 0.10825347900390625 length of segment : 368 time for calcul the mask position with numpy : 0.0005197525024414062 nb_pixel_total : 31910 time to create 1 rle with old method : 0.03392958641052246 length of segment : 165 time for calcul the mask position with numpy : 0.0027344226837158203 nb_pixel_total : 164487 time to create 1 rle with new method : 0.008365154266357422 length of segment : 604 time for calcul the mask position with numpy : 0.0005328655242919922 nb_pixel_total : 24595 time to create 1 rle with old method : 0.02681732177734375 length of segment : 238 time for calcul the mask position with numpy : 0.002278566360473633 nb_pixel_total : 135976 time to create 1 rle with old method : 0.14187979698181152 length of segment : 454 time for calcul the mask position with numpy : 0.00044846534729003906 nb_pixel_total : 28955 time to create 1 rle with old method : 0.0322117805480957 length of segment : 174 time for calcul the mask position with numpy : 0.0004951953887939453 nb_pixel_total : 12743 time to create 1 rle with old method : 0.013819217681884766 length of segment : 113 time for calcul the mask position with numpy : 0.0037546157836914062 nb_pixel_total : 122583 time to create 1 rle with old method : 0.12901091575622559 length of segment : 423 time for calcul the mask position with numpy : 0.002035379409790039 nb_pixel_total : 55884 time to create 1 rle with old method : 0.061371564865112305 length of segment : 391 time for calcul the mask position with numpy : 0.0010139942169189453 nb_pixel_total : 16622 time to create 1 rle with old method : 0.01789999008178711 length of segment : 187 time for calcul the mask position with numpy : 0.0014312267303466797 nb_pixel_total : 52667 time to create 1 rle with old method : 0.05489706993103027 length of segment : 278 time for calcul the mask position with numpy : 0.0023221969604492188 nb_pixel_total : 67030 time to create 1 rle with old method : 0.07020735740661621 length of segment : 353 time for calcul the mask position with numpy : 0.0017538070678710938 nb_pixel_total : 53653 time to create 1 rle with old method : 0.057374000549316406 length of segment : 271 time for calcul the mask position with numpy : 0.000644683837890625 nb_pixel_total : 14469 time to create 1 rle with old method : 0.0162351131439209 length of segment : 172 time for calcul the mask position with numpy : 0.000415802001953125 nb_pixel_total : 8980 time to create 1 rle with old method : 0.00996255874633789 length of segment : 99 time for calcul the mask position with numpy : 0.002837657928466797 nb_pixel_total : 99071 time to create 1 rle with old method : 0.10780477523803711 length of segment : 313 time for calcul the mask position with numpy : 0.0011496543884277344 nb_pixel_total : 26708 time to create 1 rle with old method : 0.029063940048217773 length of segment : 201 time for calcul the mask position with numpy : 0.005270481109619141 nb_pixel_total : 123232 time to create 1 rle with old method : 0.12719392776489258 length of segment : 562 time for calcul the mask position with numpy : 0.0008661746978759766 nb_pixel_total : 23628 time to create 1 rle with old method : 0.024714946746826172 length of segment : 184 time for calcul the mask position with numpy : 0.0026671886444091797 nb_pixel_total : 89985 time to create 1 rle with old method : 0.1036069393157959 length of segment : 307 time for calcul the mask position with numpy : 0.0010471343994140625 nb_pixel_total : 25315 time to create 1 rle with old method : 0.028399944305419922 length of segment : 213 time for calcul the mask position with numpy : 0.0011658668518066406 nb_pixel_total : 26988 time to create 1 rle with old method : 0.029653310775756836 length of segment : 277 time for calcul the mask position with numpy : 0.004775285720825195 nb_pixel_total : 160580 time to create 1 rle with new method : 0.00776362419128418 length of segment : 420 time for calcul the mask position with numpy : 0.002035379409790039 nb_pixel_total : 64350 time to create 1 rle with old method : 0.06944084167480469 length of segment : 322 time for calcul the mask position with numpy : 0.003172636032104492 nb_pixel_total : 63159 time to create 1 rle with old method : 0.07056522369384766 length of segment : 315 time for calcul the mask position with numpy : 0.0013260841369628906 nb_pixel_total : 21905 time to create 1 rle with old method : 0.02777385711669922 length of segment : 223 time for calcul the mask position with numpy : 0.0018825531005859375 nb_pixel_total : 44057 time to create 1 rle with old method : 0.04876112937927246 length of segment : 390 time for calcul the mask position with numpy : 0.000614166259765625 nb_pixel_total : 17123 time to create 1 rle with old method : 0.01970362663269043 length of segment : 163 time for calcul the mask position with numpy : 0.000614166259765625 nb_pixel_total : 16299 time to create 1 rle with old method : 0.019930362701416016 length of segment : 92 time for calcul the mask position with numpy : 0.0024421215057373047 nb_pixel_total : 45145 time to create 1 rle with old method : 0.05960988998413086 length of segment : 434 time for calcul the mask position with numpy : 0.009500265121459961 nb_pixel_total : 332098 time to create 1 rle with new method : 0.01750016212463379 length of segment : 665 time for calcul the mask position with numpy : 0.004061460494995117 nb_pixel_total : 186580 time to create 1 rle with new method : 0.014950275421142578 length of segment : 458 time for calcul the mask position with numpy : 0.0011692047119140625 nb_pixel_total : 36187 time to create 1 rle with old method : 0.04054975509643555 length of segment : 198 time for calcul the mask position with numpy : 0.0020852088928222656 nb_pixel_total : 47777 time to create 1 rle with old method : 0.0554661750793457 length of segment : 138 time for calcul the mask position with numpy : 0.0008552074432373047 nb_pixel_total : 17592 time to create 1 rle with old method : 0.019551515579223633 length of segment : 170 time for calcul the mask position with numpy : 0.0005154609680175781 nb_pixel_total : 20340 time to create 1 rle with old method : 0.022626876831054688 length of segment : 274 time for calcul the mask position with numpy : 0.0009272098541259766 nb_pixel_total : 20439 time to create 1 rle with old method : 0.023549556732177734 length of segment : 240 time for calcul the mask position with numpy : 0.002329111099243164 nb_pixel_total : 57668 time to create 1 rle with old method : 0.06320929527282715 length of segment : 318 time for calcul the mask position with numpy : 0.002471446990966797 nb_pixel_total : 69345 time to create 1 rle with old method : 0.07515692710876465 length of segment : 335 time for calcul the mask position with numpy : 0.003731250762939453 nb_pixel_total : 93558 time to create 1 rle with old method : 0.09929490089416504 length of segment : 349 time for calcul the mask position with numpy : 0.0005214214324951172 nb_pixel_total : 10522 time to create 1 rle with old method : 0.011665582656860352 length of segment : 98 time for calcul the mask position with numpy : 0.004563093185424805 nb_pixel_total : 142721 time to create 1 rle with old method : 0.14914393424987793 length of segment : 494 time for calcul the mask position with numpy : 0.002389669418334961 nb_pixel_total : 61565 time to create 1 rle with old method : 0.06491804122924805 length of segment : 212 time for calcul the mask position with numpy : 0.0014181137084960938 nb_pixel_total : 27059 time to create 1 rle with old method : 0.03242802619934082 length of segment : 386 time for calcul the mask position with numpy : 0.0004181861877441406 nb_pixel_total : 19741 time to create 1 rle with old method : 0.02102947235107422 length of segment : 120 time for calcul the mask position with numpy : 0.0004794597625732422 nb_pixel_total : 16819 time to create 1 rle with old method : 0.018647432327270508 length of segment : 99 time for calcul the mask position with numpy : 0.0011749267578125 nb_pixel_total : 17169 time to create 1 rle with old method : 0.01900649070739746 length of segment : 183 time for calcul the mask position with numpy : 0.0012958049774169922 nb_pixel_total : 32103 time to create 1 rle with old method : 0.03388810157775879 length of segment : 284 time for calcul the mask position with numpy : 0.0006754398345947266 nb_pixel_total : 13049 time to create 1 rle with old method : 0.014582157135009766 length of segment : 141 time for calcul the mask position with numpy : 0.0014696121215820312 nb_pixel_total : 20936 time to create 1 rle with old method : 0.02335834503173828 length of segment : 208 time spent for convertir_results : 9.005093097686768 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 89 chid ids of type : 3594 Number RLEs to save : 29584 save missing photos in datou_result : time spend for datou_step_exec : 56.40221047401428 time spend to save output : 3.2391250133514404 total time spend for step 1 : 59.64133548736572 step2:crop_condition Sat Oct 11 12:41:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 9 ! batch 1 Loaded 89 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 47 About to insert : list_path_to_insert length 47 new photo from crops ! About to upload 47 photos upload in portfolio : 3736932 init cache_photo without model_param we have 47 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760179310_2475663 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930098_f57821e94408693ac75e37c5c2142dcb_rle_crop_3994420571_0.png', 0, 118, 271, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930098_f57821e94408693ac75e37c5c2142dcb_rle_crop_3994420573_0.png', 0, 178, 115, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930098_f57821e94408693ac75e37c5c2142dcb_rle_crop_3994420572_0.png', 0, 274, 303, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930098_f57821e94408693ac75e37c5c2142dcb_rle_crop_3994420569_0.png', 0, 247, 254, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420583_0.png', 0, 171, 191, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420579_0.png', 0, 238, 145, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420576_0.png', 0, 202, 435, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420586_0.png', 0, 353, 544, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420584_0.png', 0, 359, 144, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420585_0.png', 0, 507, 496, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420580_0.png', 0, 292, 172, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420577_0.png', 0, 437, 721, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420581_0.png', 0, 513, 504, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420593_0.png', 0, 200, 406, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420591_0.png', 0, 334, 489, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420588_0.png', 0, 600, 580, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420592_0.png', 0, 403, 357, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420596_0.png', 0, 87, 327, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420594_0.png', 0, 173, 221, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930086_1ed65c5c65efc48d4849bc20c940b77b_rle_crop_3994420601_0.png', 0, 326, 218, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930086_1ed65c5c65efc48d4849bc20c940b77b_rle_crop_3994420604_0.png', 0, 181, 139, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930086_1ed65c5c65efc48d4849bc20c940b77b_rle_crop_3994420598_0.png', 0, 642, 761, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930081_003beb0f33255e3316885e2964efceb1_rle_crop_3994420606_0.png', 0, 1076, 756, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420617_0.png', 0, 215, 183, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420610_0.png', 0, 441, 604, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420621_0.png', 0, 162, 171, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420615_0.png', 0, 423, 421, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420614_0.png', 0, 145, 112, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420611_0.png', 0, 183, 238, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420612_0.png', 0, 392, 454, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420633_0.png', 0, 149, 221, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420632_0.png', 0, 451, 263, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420627_0.png', 0, 366, 305, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420628_0.png', 0, 224, 213, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420629_0.png', 0, 167, 263, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420625_0.png', 0, 350, 562, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e_rle_crop_3994420635_0.png', 0, 132, 163, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e_rle_crop_3994420641_0.png', 0, 776, 141, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420654_0.png', 0, 234, 183, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420645_0.png', 0, 283, 293, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420644_0.png', 0, 238, 144, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420649_0.png', 0, 410, 494, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420655_0.png', 0, 167, 284, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420651_0.png', 0, 227, 293, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420657_0.png', 0, 248, 221, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420646_0.png', 0, 295, 335, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179320), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420647_0.png', 0, 417, 347, 0, 1760179320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 47 photos in the portfolio 3736932 time of upload the photos Elapsed time : 15.137372970581055 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760179328_2475663 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179329), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930098_f57821e94408693ac75e37c5c2142dcb_rle_crop_3994420574_0.png', 0, 231, 365, 0, 1760179329,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179329), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420578_0.png', 0, 373, 540, 0, 1760179329,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179329), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420597_0.png', 0, 92, 131, 0, 1760179329,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179329), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420624_0.png', 0, 203, 201, 0, 1760179329,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179329), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420623_0.png', 0, 395, 311, 0, 1760179329,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179329), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e_rle_crop_3994420642_0.png', 0, 140, 165, 0, 1760179329,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179329), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e_rle_crop_3994420636_0.png', 0, 297, 90, 0, 1760179329,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.3569376468658447 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760179332_2475663 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179334), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930086_1ed65c5c65efc48d4849bc20c940b77b_rle_crop_3994420599_0.png', 0, 117, 108, 0, 1760179334,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179334), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930086_1ed65c5c65efc48d4849bc20c940b77b_rle_crop_3994420600_0.png', 0, 247, 209, 0, 1760179334,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179334), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420613_0.png', 0, 240, 143, 0, 1760179334,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179334), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420622_0.png', 0, 122, 99, 0, 1760179334,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179334), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420652_0.png', 0, 211, 118, 0, 1760179334,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.271454095840454 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 27 About to insert : list_path_to_insert length 27 new photo from crops ! About to upload 27 photos upload in portfolio : 3736932 init cache_photo without model_param we have 27 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760179345_2475663 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179353), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930098_f57821e94408693ac75e37c5c2142dcb_rle_crop_3994420570_0.png', 0, 309, 259, 0, 1760179353,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179353), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420575_0.png', 0, 823, 470, 0, 1760179353,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179353), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420587_0.png', 0, 220, 301, 0, 1760179353,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179353), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420582_0.png', 0, 463, 427, 0, 1760179353,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179353), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420589_0.png', 0, 363, 273, 0, 1760179353,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179353), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420590_0.png', 0, 387, 201, 0, 1760179353,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179353), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420595_0.png', 0, 386, 476, 0, 1760179353,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179353), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930086_1ed65c5c65efc48d4849bc20c940b77b_rle_crop_3994420603_0.png', 0, 101, 71, 0, 1760179353,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179353), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930086_1ed65c5c65efc48d4849bc20c940b77b_rle_crop_3994420602_0.png', 0, 508, 499, 0, 1760179353,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179353), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930081_003beb0f33255e3316885e2964efceb1_rle_crop_3994420605_0.png', 0, 297, 210, 0, 1760179353,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179353), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930081_003beb0f33255e3316885e2964efceb1_rle_crop_3994420609_0.png', 0, 255, 149, 0, 1760179353,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179353), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930081_003beb0f33255e3316885e2964efceb1_rle_crop_3994420607_0.png', 0, 292, 371, 0, 1760179353,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179353), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420618_0.png', 0, 249, 255, 0, 1760179353,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179353), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420619_0.png', 0, 296, 329, 0, 1760179353,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179353), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420616_0.png', 0, 306, 314, 0, 1760179353,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179353), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420620_0.png', 0, 291, 267, 0, 1760179353,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179353), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420634_0.png', 0, 175, 345, 0, 1760179353,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179353), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420631_0.png', 0, 327, 322, 0, 1760179353,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179353), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420626_0.png', 0, 160, 183, 0, 1760179353,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179353), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e_rle_crop_3994420640_0.png', 0, 212, 198, 0, 1760179353,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179353), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e_rle_crop_3994420643_0.png', 0, 121, 271, 0, 1760179353,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179353), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e_rle_crop_3994420637_0.png', 0, 279, 347, 0, 1760179353,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179353), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e_rle_crop_3994420639_0.png', 0, 552, 445, 0, 1760179353,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179353), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e_rle_crop_3994420638_0.png', 0, 1004, 481, 0, 1760179353,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179353), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420653_0.png', 0, 205, 99, 0, 1760179353,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179353), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420648_0.png', 0, 179, 98, 0, 1760179353,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179353), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420650_0.png', 0, 473, 180, 0, 1760179353,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 27 photos in the portfolio 3736932 time of upload the photos Elapsed time : 11.364421606063843 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760179358_2475663 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179358), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930081_003beb0f33255e3316885e2964efceb1_rle_crop_3994420608_0.png', 0, 376, 334, 0, 1760179358,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179358), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420656_0.png', 0, 132, 141, 0, 1760179358,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0600707530975342 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760179360_2475663 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760179361), 0.0, 0.0, 14, '', 0, 0, '1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420630_0.png', 0, 530, 420, 0, 1760179361,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.777275562286377 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1388930098, 1388930093, 1388930089, 1388930086, 1388930081, 1388930079, 1388930077, 1388930071, 1388930068] Looping around the photos to save general results len do output : 89 /1388932500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388932685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930098', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930093', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930089', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930086', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930081', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930079', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930077', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930071', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930068', None, None, None, None, None, '3929033') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 276 time used for this insertion : 0.04362010955810547 save_final save missing photos in datou_result : time spend for datou_step_exec : 70.06493139266968 time spend to save output : 0.046885013580322266 total time spend for step 2 : 70.11181640625 step3:rle_unique_nms_with_priority Sat Oct 11 12:42:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 89 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 3.343780994415283 time for calcul the mask position with numpy : 0.8228764533996582 nb_pixel_total : 8032270 time to create 1 rle with new method : 0.8485631942749023 time for calcul the mask position with numpy : 0.024911880493164062 nb_pixel_total : 65172 time to create 1 rle with old method : 0.07153511047363281 time for calcul the mask position with numpy : 0.023547649383544922 nb_pixel_total : 16373 time to create 1 rle with old method : 0.017490148544311523 time for calcul the mask position with numpy : 0.02457404136657715 nb_pixel_total : 60032 time to create 1 rle with old method : 0.0672752857208252 time for calcul the mask position with numpy : 0.02314305305480957 nb_pixel_total : 21064 time to create 1 rle with old method : 0.022710323333740234 time for calcul the mask position with numpy : 0.025906085968017578 nb_pixel_total : 64804 time to create 1 rle with old method : 0.07068395614624023 time for calcul the mask position with numpy : 0.023204326629638672 nb_pixel_total : 34685 time to create 1 rle with old method : 0.03565526008605957 create new chi : 2.1393816471099854 time to delete rle : 0.06935834884643555 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 5324 TO DO : save crop sub photo not yet done ! save time : 0.7074933052062988 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 5.331473112106323 time for calcul the mask position with numpy : 0.7459042072296143 nb_pixel_total : 7057743 time to create 1 rle with new method : 1.2423927783966064 time for calcul the mask position with numpy : 0.02442765235900879 nb_pixel_total : 43551 time to create 1 rle with old method : 0.04674077033996582 time for calcul the mask position with numpy : 0.023094892501831055 nb_pixel_total : 4748 time to create 1 rle with old method : 0.005236387252807617 time for calcul the mask position with numpy : 0.024399280548095703 nb_pixel_total : 176282 time to create 1 rle with new method : 0.655186653137207 time for calcul the mask position with numpy : 0.023214340209960938 nb_pixel_total : 34382 time to create 1 rle with old method : 0.03673815727233887 time for calcul the mask position with numpy : 0.022999048233032227 nb_pixel_total : 24882 time to create 1 rle with old method : 0.02602410316467285 time for calcul the mask position with numpy : 0.02403712272644043 nb_pixel_total : 135898 time to create 1 rle with old method : 0.1421797275543213 time for calcul the mask position with numpy : 0.024789094924926758 nb_pixel_total : 156097 time to create 1 rle with new method : 1.153681755065918 time for calcul the mask position with numpy : 0.02456212043762207 nb_pixel_total : 38772 time to create 1 rle with old method : 0.040411949157714844 time for calcul the mask position with numpy : 0.024419069290161133 nb_pixel_total : 27215 time to create 1 rle with old method : 0.02815699577331543 time for calcul the mask position with numpy : 0.02327108383178711 nb_pixel_total : 106454 time to create 1 rle with old method : 0.11142373085021973 time for calcul the mask position with numpy : 0.024003267288208008 nb_pixel_total : 193586 time to create 1 rle with new method : 1.054140329360962 time for calcul the mask position with numpy : 0.02463054656982422 nb_pixel_total : 67013 time to create 1 rle with old method : 0.06815695762634277 time for calcul the mask position with numpy : 0.02414679527282715 nb_pixel_total : 227777 time to create 1 rle with new method : 1.1011135578155518 create new chi : 6.912803649902344 time to delete rle : 0.0015721321105957031 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 12325 TO DO : save crop sub photo not yet done ! save time : 1.4085109233856201 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 4.666962146759033 time for calcul the mask position with numpy : 0.701169490814209 nb_pixel_total : 7585499 time to create 1 rle with new method : 1.0620660781860352 time for calcul the mask position with numpy : 0.02335810661315918 nb_pixel_total : 9630 time to create 1 rle with old method : 0.010735273361206055 time for calcul the mask position with numpy : 0.023732423782348633 nb_pixel_total : 16315 time to create 1 rle with old method : 0.018119096755981445 time for calcul the mask position with numpy : 0.03975319862365723 nb_pixel_total : 106771 time to create 1 rle with old method : 0.11651349067687988 time for calcul the mask position with numpy : 0.037702322006225586 nb_pixel_total : 30860 time to create 1 rle with old method : 0.03354001045227051 time for calcul the mask position with numpy : 0.033347368240356445 nb_pixel_total : 67306 time to create 1 rle with old method : 0.07262301445007324 time for calcul the mask position with numpy : 0.023028135299682617 nb_pixel_total : 62752 time to create 1 rle with old method : 0.06789398193359375 time for calcul the mask position with numpy : 0.025232553482055664 nb_pixel_total : 116606 time to create 1 rle with old method : 0.12811875343322754 time for calcul the mask position with numpy : 0.026573657989501953 nb_pixel_total : 56950 time to create 1 rle with old method : 0.06455755233764648 time for calcul the mask position with numpy : 0.0283048152923584 nb_pixel_total : 75239 time to create 1 rle with old method : 0.08259105682373047 time for calcul the mask position with numpy : 0.024919986724853516 nb_pixel_total : 166472 time to create 1 rle with new method : 0.881943941116333 create new chi : 3.598397970199585 time to delete rle : 0.0014138221740722656 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 10290 TO DO : save crop sub photo not yet done ! save time : 1.1816065311431885 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 4.046938180923462 time for calcul the mask position with numpy : 0.8094158172607422 nb_pixel_total : 7689452 time to create 1 rle with new method : 0.7306807041168213 time for calcul the mask position with numpy : 0.024103879928588867 nb_pixel_total : 19206 time to create 1 rle with old method : 0.02122783660888672 time for calcul the mask position with numpy : 0.023378610610961914 nb_pixel_total : 5599 time to create 1 rle with old method : 0.00606846809387207 time for calcul the mask position with numpy : 0.02432990074157715 nb_pixel_total : 165019 time to create 1 rle with new method : 0.6185634136199951 time for calcul the mask position with numpy : 0.023549318313598633 nb_pixel_total : 42915 time to create 1 rle with old method : 0.04697585105895996 time for calcul the mask position with numpy : 0.024142742156982422 nb_pixel_total : 39273 time to create 1 rle with old method : 0.04424118995666504 time for calcul the mask position with numpy : 0.024296283721923828 nb_pixel_total : 10248 time to create 1 rle with old method : 0.01140904426574707 time for calcul the mask position with numpy : 0.02538299560546875 nb_pixel_total : 322688 time to create 1 rle with new method : 0.9420473575592041 create new chi : 3.4934728145599365 time to delete rle : 0.0010437965393066406 batch 1 Loaded 15 chid ids of type : 3594 ++++++++++Number RLEs to save : 6384 TO DO : save crop sub photo not yet done ! save time : 0.7938971519470215 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 2.906510353088379 time for calcul the mask position with numpy : 0.8622863292694092 nb_pixel_total : 7562723 time to create 1 rle with new method : 0.8983304500579834 time for calcul the mask position with numpy : 0.022813081741333008 nb_pixel_total : 31910 time to create 1 rle with old method : 0.03429865837097168 time for calcul the mask position with numpy : 0.023686647415161133 nb_pixel_total : 101743 time to create 1 rle with old method : 0.11159086227416992 time for calcul the mask position with numpy : 0.023518085479736328 nb_pixel_total : 56250 time to create 1 rle with old method : 0.06014394760131836 time for calcul the mask position with numpy : 0.02645421028137207 nb_pixel_total : 497615 time to create 1 rle with new method : 0.8472471237182617 time for calcul the mask position with numpy : 0.02927231788635254 nb_pixel_total : 44159 time to create 1 rle with old method : 0.05026102066040039 create new chi : 3.0653908252716064 time to delete rle : 0.0012850761413574219 batch 1 Loaded 11 chid ids of type : 3594 ++++++++++Number RLEs to save : 7478 TO DO : save crop sub photo not yet done ! save time : 0.9133603572845459 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 6.071499586105347 time for calcul the mask position with numpy : 0.8478100299835205 nb_pixel_total : 7536013 time to create 1 rle with new method : 0.8830184936523438 time for calcul the mask position with numpy : 0.023207426071166992 nb_pixel_total : 8980 time to create 1 rle with old method : 0.010179996490478516 time for calcul the mask position with numpy : 0.02516770362854004 nb_pixel_total : 14469 time to create 1 rle with old method : 0.015891075134277344 time for calcul the mask position with numpy : 0.024794578552246094 nb_pixel_total : 53653 time to create 1 rle with old method : 0.06368136405944824 time for calcul the mask position with numpy : 0.02407526969909668 nb_pixel_total : 66773 time to create 1 rle with old method : 0.07320022583007812 time for calcul the mask position with numpy : 0.024831533432006836 nb_pixel_total : 52667 time to create 1 rle with old method : 0.05739307403564453 time for calcul the mask position with numpy : 0.023619890213012695 nb_pixel_total : 16622 time to create 1 rle with old method : 0.018742799758911133 time for calcul the mask position with numpy : 0.02588033676147461 nb_pixel_total : 55884 time to create 1 rle with old method : 0.06236863136291504 time for calcul the mask position with numpy : 0.025580883026123047 nb_pixel_total : 122583 time to create 1 rle with old method : 0.1318988800048828 time for calcul the mask position with numpy : 0.02518749237060547 nb_pixel_total : 12743 time to create 1 rle with old method : 0.013994455337524414 time for calcul the mask position with numpy : 0.02592945098876953 nb_pixel_total : 28955 time to create 1 rle with old method : 0.03194999694824219 time for calcul the mask position with numpy : 0.026108503341674805 nb_pixel_total : 135976 time to create 1 rle with old method : 0.17629241943359375 time for calcul the mask position with numpy : 0.02877044677734375 nb_pixel_total : 24595 time to create 1 rle with old method : 0.04080367088317871 time for calcul the mask position with numpy : 0.02876901626586914 nb_pixel_total : 164487 time to create 1 rle with new method : 0.9906721115112305 create new chi : 3.8174092769622803 time to delete rle : 0.0013806819915771484 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 9649 TO DO : save crop sub photo not yet done ! save time : 1.1305873394012451 nb_obj : 12 nb_hashtags : 4 time to prepare the origin masks : 6.213879346847534 time for calcul the mask position with numpy : 0.8553495407104492 nb_pixel_total : 7525422 time to create 1 rle with new method : 0.6573455333709717 time for calcul the mask position with numpy : 0.025139331817626953 nb_pixel_total : 44057 time to create 1 rle with old method : 0.04824066162109375 time for calcul the mask position with numpy : 0.024289369583129883 nb_pixel_total : 21905 time to create 1 rle with old method : 0.024183034896850586 time for calcul the mask position with numpy : 0.023592472076416016 nb_pixel_total : 63159 time to create 1 rle with old method : 0.06630086898803711 time for calcul the mask position with numpy : 0.023710012435913086 nb_pixel_total : 64350 time to create 1 rle with old method : 0.06812548637390137 time for calcul the mask position with numpy : 0.023488283157348633 nb_pixel_total : 160580 time to create 1 rle with new method : 0.9962282180786133 time for calcul the mask position with numpy : 0.02499675750732422 nb_pixel_total : 26988 time to create 1 rle with old method : 0.028764724731445312 time for calcul the mask position with numpy : 0.02469658851623535 nb_pixel_total : 25315 time to create 1 rle with old method : 0.027047395706176758 time for calcul the mask position with numpy : 0.024218082427978516 nb_pixel_total : 89985 time to create 1 rle with old method : 0.09494447708129883 time for calcul the mask position with numpy : 0.023390531539916992 nb_pixel_total : 23628 time to create 1 rle with old method : 0.024842262268066406 time for calcul the mask position with numpy : 0.024744510650634766 nb_pixel_total : 123232 time to create 1 rle with old method : 0.1315782070159912 time for calcul the mask position with numpy : 0.0248870849609375 nb_pixel_total : 26708 time to create 1 rle with old method : 0.028877735137939453 time for calcul the mask position with numpy : 0.025002002716064453 nb_pixel_total : 99071 time to create 1 rle with old method : 0.10367059707641602 create new chi : 3.5246222019195557 time to delete rle : 0.0014095306396484375 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 9614 TO DO : save crop sub photo not yet done ! save time : 1.1176292896270752 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 5.216275215148926 time for calcul the mask position with numpy : 0.9917168617248535 nb_pixel_total : 7575894 time to create 1 rle with new method : 1.189582109451294 time for calcul the mask position with numpy : 0.023020267486572266 nb_pixel_total : 19705 time to create 1 rle with old method : 0.02145552635192871 time for calcul the mask position with numpy : 0.023733139038085938 nb_pixel_total : 17592 time to create 1 rle with old method : 0.019214391708374023 time for calcul the mask position with numpy : 0.024253129959106445 nb_pixel_total : 47777 time to create 1 rle with old method : 0.052550315856933594 time for calcul the mask position with numpy : 0.02553868293762207 nb_pixel_total : 36187 time to create 1 rle with old method : 0.03948664665222168 time for calcul the mask position with numpy : 0.02456045150756836 nb_pixel_total : 186580 time to create 1 rle with new method : 0.9872922897338867 time for calcul the mask position with numpy : 0.027085065841674805 nb_pixel_total : 332098 time to create 1 rle with new method : 0.7428445816040039 time for calcul the mask position with numpy : 0.023653745651245117 nb_pixel_total : 45145 time to create 1 rle with old method : 0.04861593246459961 time for calcul the mask position with numpy : 0.024698495864868164 nb_pixel_total : 16299 time to create 1 rle with old method : 0.017557621002197266 time for calcul the mask position with numpy : 0.024465560913085938 nb_pixel_total : 17123 time to create 1 rle with old method : 0.018720149993896484 create new chi : 4.444414854049683 time to delete rle : 0.0010766983032226562 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 7270 TO DO : save crop sub photo not yet done ! save time : 0.9053866863250732 nb_obj : 14 nb_hashtags : 4 time to prepare the origin masks : 7.2790281772613525 time for calcul the mask position with numpy : 0.8225386142730713 nb_pixel_total : 7691706 time to create 1 rle with new method : 1.0165178775787354 time for calcul the mask position with numpy : 0.023209810256958008 nb_pixel_total : 20936 time to create 1 rle with old method : 0.02310657501220703 time for calcul the mask position with numpy : 0.02360057830810547 nb_pixel_total : 13049 time to create 1 rle with old method : 0.0143585205078125 time for calcul the mask position with numpy : 0.0250244140625 nb_pixel_total : 32103 time to create 1 rle with old method : 0.035265207290649414 time for calcul the mask position with numpy : 0.023856401443481445 nb_pixel_total : 17169 time to create 1 rle with old method : 0.018241405487060547 time for calcul the mask position with numpy : 0.023641109466552734 nb_pixel_total : 16819 time to create 1 rle with old method : 0.01778125762939453 time for calcul the mask position with numpy : 0.024268388748168945 nb_pixel_total : 19741 time to create 1 rle with old method : 0.021537303924560547 time for calcul the mask position with numpy : 0.023991823196411133 nb_pixel_total : 27059 time to create 1 rle with old method : 0.029524803161621094 time for calcul the mask position with numpy : 0.02361917495727539 nb_pixel_total : 61565 time to create 1 rle with old method : 0.06522798538208008 time for calcul the mask position with numpy : 0.025312423706054688 nb_pixel_total : 142721 time to create 1 rle with old method : 0.15259027481079102 time for calcul the mask position with numpy : 0.023847103118896484 nb_pixel_total : 10522 time to create 1 rle with old method : 0.011630535125732422 time for calcul the mask position with numpy : 0.02517843246459961 nb_pixel_total : 93558 time to create 1 rle with old method : 0.09983611106872559 time for calcul the mask position with numpy : 0.024582624435424805 nb_pixel_total : 69345 time to create 1 rle with old method : 0.07457566261291504 time for calcul the mask position with numpy : 0.024004220962524414 nb_pixel_total : 57668 time to create 1 rle with old method : 0.06109333038330078 time for calcul the mask position with numpy : 0.023517847061157227 nb_pixel_total : 20439 time to create 1 rle with old method : 0.02171468734741211 create new chi : 2.8653693199157715 time to delete rle : 0.0013670921325683594 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 9094 TO DO : save crop sub photo not yet done ! save time : 1.0768015384674072 map_output_result : {1388930098: (0.0, 'Should be the crop_list due to order', 0), 1388930093: (0.0, 'Should be the crop_list due to order', 0), 1388930089: (0.0, 'Should be the crop_list due to order', 0), 1388930086: (0.0, 'Should be the crop_list due to order', 0), 1388930081: (0.0, 'Should be the crop_list due to order', 0), 1388930079: (0.0, 'Should be the crop_list due to order', 0), 1388930077: (0.0, 'Should be the crop_list due to order', 0), 1388930071: (0.0, 'Should be the crop_list due to order', 0), 1388930068: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1388930098, 1388930093, 1388930089, 1388930086, 1388930081, 1388930079, 1388930077, 1388930071, 1388930068] Looping around the photos to save general results len do output : 9 /1388930098.Didn't retrieve data . /1388930093.Didn't retrieve data . /1388930089.Didn't retrieve data . /1388930086.Didn't retrieve data . /1388930081.Didn't retrieve data . /1388930079.Didn't retrieve data . /1388930077.Didn't retrieve data . /1388930071.Didn't retrieve data . /1388930068.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930098', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930093', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930089', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930086', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930081', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930079', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930077', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930071', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930068', None, None, None, None, None, '3929033') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.03962516784667969 save_final save missing photos in datou_result : time spend for datou_step_exec : 89.51176476478577 time spend to save output : 0.04031085968017578 total time spend for step 3 : 89.55207562446594 step4:ventilate_hashtags_in_portfolio Sat Oct 11 12:44:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 27729672 get user id for portfolio 27729672 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27729672 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','pehd','flou','carton','papier','metal','pet_fonce','mal_croppe','autre','pet_clair','environnement')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27729672 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','pehd','flou','carton','papier','metal','pet_fonce','mal_croppe','autre','pet_clair','environnement')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27729672 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','pehd','flou','carton','papier','metal','pet_fonce','mal_croppe','autre','pet_clair','environnement')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/27729851,27729852,27729853,27729854,27729855,27729856,27729857,27729858,27729859,27729860,27729861?tags=background,pehd,flou,carton,papier,metal,pet_fonce,mal_croppe,autre,pet_clair,environnement Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1388930098, 1388930093, 1388930089, 1388930086, 1388930081, 1388930079, 1388930077, 1388930071, 1388930068] Looping around the photos to save general results len do output : 1 /27729672. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930098', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930093', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930089', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930086', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930081', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930079', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930077', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930071', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930068', None, None, None, None, None, '3929033') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.037520647048950195 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.515878200531006 time spend to save output : 0.03782463073730469 total time spend for step 4 : 5.5537028312683105 step5:final Sat Oct 11 12:44:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1388930098: ('0.08563847629458161',), 1388930093: ('0.08563847629458161',), 1388930089: ('0.08563847629458161',), 1388930086: ('0.08563847629458161',), 1388930081: ('0.08563847629458161',), 1388930079: ('0.08563847629458161',), 1388930077: ('0.08563847629458161',), 1388930071: ('0.08563847629458161',), 1388930068: ('0.08563847629458161',)} new output for save of step final : {1388930098: ('0.08563847629458161',), 1388930093: ('0.08563847629458161',), 1388930089: ('0.08563847629458161',), 1388930086: ('0.08563847629458161',), 1388930081: ('0.08563847629458161',), 1388930079: ('0.08563847629458161',), 1388930077: ('0.08563847629458161',), 1388930071: ('0.08563847629458161',), 1388930068: ('0.08563847629458161',)} [1388930098, 1388930093, 1388930089, 1388930086, 1388930081, 1388930079, 1388930077, 1388930071, 1388930068] Looping around the photos to save general results len do output : 9 /1388930098.Didn't retrieve data . /1388930093.Didn't retrieve data . /1388930089.Didn't retrieve data . /1388930086.Didn't retrieve data . /1388930081.Didn't retrieve data . /1388930079.Didn't retrieve data . /1388930077.Didn't retrieve data . /1388930071.Didn't retrieve data . /1388930068.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930098', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930093', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930089', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930086', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930081', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930079', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930077', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930071', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930068', None, None, None, None, None, '3929033') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.03738808631896973 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.40209078788757324 time spend to save output : 0.037770986557006836 total time spend for step 5 : 0.4398617744445801 step6:blur_detection Sat Oct 11 12:44:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1760179229_2475663_1388930098_f57821e94408693ac75e37c5c2142dcb.jpg resize: (2160, 3840) 1388930098 -7.05533364081537 treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13.jpg resize: (2160, 3840) 1388930093 -6.991723351106809 treat image : temp/1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17.jpg resize: (2160, 3840) 1388930089 -7.122556056397942 treat image : temp/1760179229_2475663_1388930086_1ed65c5c65efc48d4849bc20c940b77b.jpg resize: (2160, 3840) 1388930086 -7.060003620423371 treat image : temp/1760179229_2475663_1388930081_003beb0f33255e3316885e2964efceb1.jpg resize: (2160, 3840) 1388930081 -6.946346624845862 treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a.jpg resize: (2160, 3840) 1388930079 -6.959993976547908 treat image : temp/1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e.jpg resize: (2160, 3840) 1388930077 -7.057060788749986 treat image : temp/1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e.jpg resize: (2160, 3840) 1388930071 -5.999330345669371 treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161.jpg resize: (2160, 3840) 1388930068 -6.465731255587715 treat image : temp/1760179229_2475663_1388930098_f57821e94408693ac75e37c5c2142dcb_rle_crop_3994420571_0.png resize: (271, 118) 1388932500 -4.565837168124177 treat image : temp/1760179229_2475663_1388930098_f57821e94408693ac75e37c5c2142dcb_rle_crop_3994420573_0.png resize: (115, 178) 1388932501 -4.003029922835882 treat image : temp/1760179229_2475663_1388930098_f57821e94408693ac75e37c5c2142dcb_rle_crop_3994420572_0.png resize: (303, 274) 1388932502 -4.441219480174044 treat image : temp/1760179229_2475663_1388930098_f57821e94408693ac75e37c5c2142dcb_rle_crop_3994420569_0.png resize: (254, 247) 1388932503 -3.6650101046801042 treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420583_0.png resize: (191, 171) 1388932504 -4.3961527630251185 treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420579_0.png resize: (145, 238) 1388932505 -4.562040064372187 treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420576_0.png resize: (435, 202) 1388932506 -3.305555312992246 treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420586_0.png resize: (544, 353) 1388932507 -4.1221428817477745 treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420584_0.png resize: (144, 359) 1388932508 -3.999020240213354 treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420585_0.png resize: (496, 507) 1388932509 -4.736803189780805 treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420580_0.png resize: (172, 292) 1388932510 -3.211675696101135 treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420577_0.png resize: (721, 437) 1388932511 -5.134865782439603 treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420581_0.png resize: (504, 513) 1388932512 -3.226318441891146 treat image : temp/1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420593_0.png resize: (406, 200) 1388932513 -5.645724684228612 treat image : temp/1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420591_0.png resize: (489, 334) 1388932514 -5.158899067842922 treat image : temp/1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420588_0.png resize: (580, 600) 1388932515 -3.8003788526755944 treat image : temp/1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420592_0.png resize: (357, 403) 1388932516 -2.4740122260720367 treat image : temp/1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420596_0.png resize: (327, 87) 1388932517 -3.6279144644631733 treat image : temp/1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420594_0.png resize: (221, 173) 1388932518 -3.7381839557740064 treat image : temp/1760179229_2475663_1388930086_1ed65c5c65efc48d4849bc20c940b77b_rle_crop_3994420601_0.png resize: (218, 326) 1388932520 -3.7594600825583906 treat image : temp/1760179229_2475663_1388930086_1ed65c5c65efc48d4849bc20c940b77b_rle_crop_3994420604_0.png resize: (139, 181) 1388932521 -4.398170044030629 treat image : temp/1760179229_2475663_1388930086_1ed65c5c65efc48d4849bc20c940b77b_rle_crop_3994420598_0.png resize: (761, 642) 1388932522 -5.358740971117389 treat image : temp/1760179229_2475663_1388930081_003beb0f33255e3316885e2964efceb1_rle_crop_3994420606_0.png resize: (756, 1076) 1388932523 -5.466475682637808 treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420617_0.png resize: (183, 215) 1388932524 -3.7119909436748317 treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420610_0.png resize: (604, 441) 1388932525 -5.791204283102699 treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420621_0.png resize: (171, 162) 1388932526 -4.276821424325119 treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420615_0.png resize: (421, 423) 1388932527 -4.635961828143789 treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420614_0.png resize: (112, 145) 1388932528 -2.9563002653478163 treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420611_0.png resize: (238, 183) 1388932529 -4.573292399911456 treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420612_0.png resize: (454, 392) 1388932530 -4.054431792924921 treat image : temp/1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420633_0.png resize: (221, 149) 1388932531 -3.013633961503536 treat image : temp/1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420632_0.png resize: (263, 451) 1388932532 -5.199862127930438 treat image : temp/1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420627_0.png resize: (305, 366) 1388932533 -5.121689265824127 treat image : temp/1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420628_0.png resize: (213, 224) 1388932534 -4.066316285933644 treat image : temp/1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420629_0.png resize: (263, 167) 1388932535 -2.403706192575396 treat image : temp/1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420625_0.png resize: (562, 350) 1388932536 -3.4853143743638286 treat image : temp/1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e_rle_crop_3994420635_0.png resize: (163, 132) 1388932537 -5.007472996667137 treat image : temp/1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e_rle_crop_3994420641_0.png resize: (141, 776) 1388932539 -4.7303377268472975 treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420654_0.png resize: (183, 234) 1388932540 -4.182078073321145 treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420645_0.png resize: (293, 283) 1388932542 -4.3339598340202885 treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420644_0.png resize: (144, 238) 1388932543 -4.274280320314135 treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420649_0.png resize: (494, 410) 1388932544 -5.453311651958233 treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420655_0.png resize: (284, 167) 1388932545 -4.708737194638024 treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420651_0.png resize: (293, 227) 1388932546 -4.00981809087607 treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420657_0.png resize: (221, 248) 1388932547 -4.189681818734326 treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420646_0.png resize: (335, 295) 1388932548 -4.553080138803287 treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420647_0.png resize: (347, 417) 1388932549 -4.571621522367541 treat image : temp/1760179229_2475663_1388930098_f57821e94408693ac75e37c5c2142dcb_rle_crop_3994420574_0.png resize: (365, 231) 1388932552 -2.913842028149692 treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420578_0.png resize: (540, 373) 1388932553 -4.0347433971107005 treat image : temp/1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420597_0.png resize: (131, 92) 1388932554 -2.677024785164798 treat image : temp/1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420624_0.png resize: (201, 203) 1388932555 -4.420379733237975 treat image : temp/1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420623_0.png resize: (311, 395) 1388932556 -2.4426532796034217 treat image : temp/1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e_rle_crop_3994420642_0.png resize: (165, 140) 1388932557 -3.55372789109418 treat image : temp/1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e_rle_crop_3994420636_0.png resize: (90, 297) 1388932558 -2.568043028425563 treat image : temp/1760179229_2475663_1388930086_1ed65c5c65efc48d4849bc20c940b77b_rle_crop_3994420599_0.png resize: (108, 117) 1388932560 -4.455593537423141 treat image : temp/1760179229_2475663_1388930086_1ed65c5c65efc48d4849bc20c940b77b_rle_crop_3994420600_0.png resize: (209, 247) 1388932561 -5.17725867545203 treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420613_0.png resize: (143, 240) 1388932562 -5.121870228352085 treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420622_0.png resize: (99, 122) 1388932563 -5.146630600693192 treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420652_0.png resize: (118, 211) 1388932564 -4.956684160319537 treat image : temp/1760179229_2475663_1388930098_f57821e94408693ac75e37c5c2142dcb_rle_crop_3994420570_0.png resize: (259, 309) 1388932651 -4.354543834448454 treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420575_0.png resize: (470, 823) 1388932652 -4.5557290087616025 treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420587_0.png resize: (301, 220) 1388932653 -3.9093820530388883 treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420582_0.png resize: (427, 463) 1388932654 -3.6559405459805068 treat image : temp/1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420589_0.png resize: (273, 363) 1388932656 -5.1593666023254725 treat image : temp/1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420590_0.png resize: (201, 387) 1388932657 -4.339102166819619 treat image : temp/1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420595_0.png resize: (476, 386) 1388932658 -4.958307007482655 treat image : temp/1760179229_2475663_1388930086_1ed65c5c65efc48d4849bc20c940b77b_rle_crop_3994420603_0.png resize: (71, 101) 1388932659 -3.801313921198059 treat image : temp/1760179229_2475663_1388930086_1ed65c5c65efc48d4849bc20c940b77b_rle_crop_3994420602_0.png resize: (499, 508) 1388932660 -5.211780113612711 treat image : temp/1760179229_2475663_1388930081_003beb0f33255e3316885e2964efceb1_rle_crop_3994420605_0.png resize: (210, 297) 1388932662 -5.95154413890111 treat image : temp/1760179229_2475663_1388930081_003beb0f33255e3316885e2964efceb1_rle_crop_3994420609_0.png resize: (149, 255) 1388932663 -4.461552007621009 treat image : temp/1760179229_2475663_1388930081_003beb0f33255e3316885e2964efceb1_rle_crop_3994420607_0.png resize: (371, 292) 1388932664 -4.763813170420988 treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420618_0.png resize: (255, 249) 1388932665 -4.840273100946633 treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420619_0.png resize: (329, 296) 1388932666 -4.309885139174724 treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420616_0.png resize: (314, 306) 1388932667 -3.803023697420019 treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420620_0.png resize: (267, 291) 1388932668 -4.325624913938246 treat image : temp/1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420634_0.png resize: (345, 175) 1388932669 -5.194373865006134 treat image : temp/1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420631_0.png resize: (322, 327) 1388932670 -5.525060755760962 treat image : temp/1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420626_0.png resize: (183, 160) 1388932671 -2.837530686336104 treat image : temp/1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e_rle_crop_3994420640_0.png resize: (198, 212) 1388932672 -4.127490302592716 treat image : temp/1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e_rle_crop_3994420643_0.png resize: (271, 121) 1388932673 -4.617558045541171 treat image : temp/1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e_rle_crop_3994420637_0.png resize: (347, 279) 1388932674 -4.262131868256099 treat image : temp/1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e_rle_crop_3994420639_0.png resize: (445, 552) 1388932675 -4.979488976419339 treat image : temp/1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e_rle_crop_3994420638_0.png resize: (481, 1004) 1388932676 -4.173861072441623 treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420653_0.png resize: (99, 205) 1388932677 -3.795505022100025 treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420648_0.png resize: (98, 179) 1388932678 -4.830013184151795 treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420650_0.png resize: (180, 473) 1388932679 -5.103976130291579 treat image : temp/1760179229_2475663_1388930081_003beb0f33255e3316885e2964efceb1_rle_crop_3994420608_0.png resize: (334, 376) 1388932681 -2.063671189982073 treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420656_0.png resize: (141, 132) 1388932682 -4.469698172607375 treat image : temp/1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420630_0.png resize: (420, 530) 1388932685 -4.380206834298854 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 98 time used for this insertion : 0.0393221378326416 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 98 time used for this insertion : 0.03964424133300781 save missing photos in datou_result : time spend for datou_step_exec : 34.5053436756134 time spend to save output : 0.09663558006286621 total time spend for step 6 : 34.60197925567627 step7:brightness Sat Oct 11 12:44:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1760179229_2475663_1388930098_f57821e94408693ac75e37c5c2142dcb.jpg treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13.jpg treat image : temp/1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17.jpg treat image : temp/1760179229_2475663_1388930086_1ed65c5c65efc48d4849bc20c940b77b.jpg treat image : temp/1760179229_2475663_1388930081_003beb0f33255e3316885e2964efceb1.jpg treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a.jpg treat image : temp/1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e.jpg treat image : temp/1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e.jpg treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161.jpg treat image : temp/1760179229_2475663_1388930098_f57821e94408693ac75e37c5c2142dcb_rle_crop_3994420571_0.png treat image : temp/1760179229_2475663_1388930098_f57821e94408693ac75e37c5c2142dcb_rle_crop_3994420573_0.png treat image : temp/1760179229_2475663_1388930098_f57821e94408693ac75e37c5c2142dcb_rle_crop_3994420572_0.png treat image : temp/1760179229_2475663_1388930098_f57821e94408693ac75e37c5c2142dcb_rle_crop_3994420569_0.png treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420583_0.png treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420579_0.png treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420576_0.png treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420586_0.png treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420584_0.png treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420585_0.png treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420580_0.png treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420577_0.png treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420581_0.png treat image : temp/1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420593_0.png treat image : temp/1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420591_0.png treat image : temp/1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420588_0.png treat image : temp/1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420592_0.png treat image : temp/1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420596_0.png treat image : temp/1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420594_0.png treat image : temp/1760179229_2475663_1388930086_1ed65c5c65efc48d4849bc20c940b77b_rle_crop_3994420601_0.png treat image : temp/1760179229_2475663_1388930086_1ed65c5c65efc48d4849bc20c940b77b_rle_crop_3994420604_0.png treat image : temp/1760179229_2475663_1388930086_1ed65c5c65efc48d4849bc20c940b77b_rle_crop_3994420598_0.png treat image : temp/1760179229_2475663_1388930081_003beb0f33255e3316885e2964efceb1_rle_crop_3994420606_0.png treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420617_0.png treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420610_0.png treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420621_0.png treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420615_0.png treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420614_0.png treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420611_0.png treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420612_0.png treat image : temp/1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420633_0.png treat image : temp/1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420632_0.png treat image : temp/1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420627_0.png treat image : temp/1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420628_0.png treat image : temp/1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420629_0.png treat image : temp/1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420625_0.png treat image : temp/1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e_rle_crop_3994420635_0.png treat image : temp/1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e_rle_crop_3994420641_0.png treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420654_0.png treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420645_0.png treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420644_0.png treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420649_0.png treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420655_0.png treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420651_0.png treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420657_0.png treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420646_0.png treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420647_0.png treat image : temp/1760179229_2475663_1388930098_f57821e94408693ac75e37c5c2142dcb_rle_crop_3994420574_0.png treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420578_0.png treat image : temp/1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420597_0.png treat image : temp/1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420624_0.png treat image : temp/1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420623_0.png treat image : temp/1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e_rle_crop_3994420642_0.png treat image : temp/1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e_rle_crop_3994420636_0.png treat image : temp/1760179229_2475663_1388930086_1ed65c5c65efc48d4849bc20c940b77b_rle_crop_3994420599_0.png treat image : temp/1760179229_2475663_1388930086_1ed65c5c65efc48d4849bc20c940b77b_rle_crop_3994420600_0.png treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420613_0.png treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420622_0.png treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420652_0.png treat image : temp/1760179229_2475663_1388930098_f57821e94408693ac75e37c5c2142dcb_rle_crop_3994420570_0.png treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420575_0.png treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420587_0.png treat image : temp/1760179229_2475663_1388930093_e853b92f57696867442e34b1a7e28e13_rle_crop_3994420582_0.png treat image : temp/1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420589_0.png treat image : temp/1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420590_0.png treat image : temp/1760179229_2475663_1388930089_46fa033d4b99c1fcea28c0fb7aa6ba17_rle_crop_3994420595_0.png treat image : temp/1760179229_2475663_1388930086_1ed65c5c65efc48d4849bc20c940b77b_rle_crop_3994420603_0.png treat image : temp/1760179229_2475663_1388930086_1ed65c5c65efc48d4849bc20c940b77b_rle_crop_3994420602_0.png treat image : temp/1760179229_2475663_1388930081_003beb0f33255e3316885e2964efceb1_rle_crop_3994420605_0.png treat image : temp/1760179229_2475663_1388930081_003beb0f33255e3316885e2964efceb1_rle_crop_3994420609_0.png treat image : temp/1760179229_2475663_1388930081_003beb0f33255e3316885e2964efceb1_rle_crop_3994420607_0.png treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420618_0.png treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420619_0.png treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420616_0.png treat image : temp/1760179229_2475663_1388930079_18ac0490e4cf7814961d76bce9ea0b7a_rle_crop_3994420620_0.png treat image : temp/1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420634_0.png treat image : temp/1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420631_0.png treat image : temp/1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420626_0.png treat image : temp/1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e_rle_crop_3994420640_0.png treat image : temp/1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e_rle_crop_3994420643_0.png treat image : temp/1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e_rle_crop_3994420637_0.png treat image : temp/1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e_rle_crop_3994420639_0.png treat image : temp/1760179229_2475663_1388930071_72a4c5dedbd1fdc05840b618cd4c1a2e_rle_crop_3994420638_0.png treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420653_0.png treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420648_0.png treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420650_0.png treat image : temp/1760179229_2475663_1388930081_003beb0f33255e3316885e2964efceb1_rle_crop_3994420608_0.png treat image : temp/1760179229_2475663_1388930068_bf3e9f5055b57ef6641e5ed8040db161_rle_crop_3994420656_0.png treat image : temp/1760179229_2475663_1388930077_9da70c1bcc886902610e9dce46d1492e_rle_crop_3994420630_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 98 time used for this insertion : 0.0439455509185791 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 98 time used for this insertion : 0.038809776306152344 save missing photos in datou_result : time spend for datou_step_exec : 9.040892362594604 time spend to save output : 0.10057210922241211 total time spend for step 7 : 9.141464471817017 step8:velours_tree Sat Oct 11 12:45:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.2051229476928711 time spend to save output : 4.100799560546875e-05 total time spend for step 8 : 0.20516395568847656 step9:send_mail_cod Sat Oct 11 12:45:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P27729672_11-10-2025_12_45_00.pdf 27729851 imagette277298511760179500 27729852 imagette277298521760179500 27729853 imagette277298531760179500 27729854 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette277298541760179500 27729855 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette277298551760179501 27729856 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette277298561760179503 27729857 change filename to text .imagette277298571760179503 27729858 imagette277298581760179503 27729859 change filename to text .change filename to text .imagette277298591760179503 27729860 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette277298601760179504 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=27729672 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/27729851,27729852,27729853,27729854,27729855,27729856,27729857,27729858,27729859,27729860,27729861?tags=background,pehd,flou,carton,papier,metal,pet_fonce,mal_croppe,autre,pet_clair,environnement args[1388930098] : ((1388930098, -7.05533364081537, 492609224), (1388930098, 0.1591334280240174, 2107752395), '0.08563847629458161') We are sending mail with results at report@fotonower.com args[1388930093] : ((1388930093, -6.991723351106809, 492609224), (1388930093, 0.35245601124439396, 2107752395), '0.08563847629458161') We are sending mail with results at report@fotonower.com args[1388930089] : ((1388930089, -7.122556056397942, 492609224), (1388930089, 0.1920454072604358, 2107752395), '0.08563847629458161') We are sending mail with results at report@fotonower.com args[1388930086] : ((1388930086, -7.060003620423371, 492609224), (1388930086, 0.10739770230075799, 2107752395), '0.08563847629458161') We are sending mail with results at report@fotonower.com args[1388930081] : ((1388930081, -6.946346624845862, 492609224), (1388930081, 0.09658168944481146, 2107752395), '0.08563847629458161') We are sending mail with results at report@fotonower.com args[1388930079] : ((1388930079, -6.959993976547908, 492609224), (1388930079, 0.06322793281513517, 2107752395), '0.08563847629458161') We are sending mail with results at report@fotonower.com args[1388930077] : ((1388930077, -7.057060788749986, 492609224), (1388930077, 0.38222902750914023, 2107752395), '0.08563847629458161') We are sending mail with results at report@fotonower.com args[1388930071] : ((1388930071, -5.999330345669371, 492609224), (1388930071, -0.20166578462879853, 496442774), '0.08563847629458161') We are sending mail with results at report@fotonower.com args[1388930068] : ((1388930068, -6.465731255587715, 492609224), (1388930068, -0.26689956883701843, 496442774), '0.08563847629458161') We are sending mail with results at report@fotonower.com refus_total : 0.08563847629458161 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=27729672 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27729672_11-10-2025_12_45_00.pdf results_Auto_P27729672_11-10-2025_12_45_00.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27729672_11-10-2025_12_45_00.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','27729672','results_Auto_P27729672_11-10-2025_12_45_00.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27729672_11-10-2025_12_45_00.pdf','pdf','','0.74','0.08563847629458161') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/27729672

https://www.fotonower.com/image?json=false&list_photos_id=1388930098
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388930093
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388930089
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388930086
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388930081
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388930079
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388930077
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388930071
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388930068
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 8.56%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/27729854?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/27729855?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/27729856?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/27729857?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/27729859?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/27729860?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27729672_11-10-2025_12_45_00.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/27729851,27729852,27729853,27729854,27729855,27729856,27729857,27729858,27729859,27729860,27729861?tags=background,pehd,flou,carton,papier,metal,pet_fonce,mal_croppe,autre,pet_clair,environnement.


L'équipe Fotonower 202 b'' Server: nginx Date: Sat, 11 Oct 2025 10:45:09 GMT Content-Length: 0 Connection: close X-Message-Id: jdCj-OJyRwGXjW3JXMyedg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1388930098, 1388930093, 1388930089, 1388930086, 1388930081, 1388930079, 1388930077, 1388930071, 1388930068] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930098', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930093', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930089', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930086', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930081', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930079', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930077', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930071', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930068', None, None, None, None, None, '3929033') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.037353515625 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.50593090057373 time spend to save output : 0.03759956359863281 total time spend for step 9 : 8.543530464172363 step10:split_time_score Sat Oct 11 12:45:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('12', 9),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 11102025 27729672 Nombre de photos uploadées : 9 / 23040 (0%) 11102025 27729672 Nombre de photos taguées (types de déchets): 0 / 9 (0%) 11102025 27729672 Nombre de photos taguées (volume) : 0 / 9 (0%) elapsed_time : load_data_split_time_score 2.6226043701171875e-06 elapsed_time : order_list_meta_photo_and_scores 7.867813110351562e-06 ????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005176067352294922 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.6401009559631348 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.06106340515194683 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27724169_11-10-2025_10_45_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27724169 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27724169 AND mptpi.`type`=3594 To do Qualite : 0.057637849395899846 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27724179_11-10-2025_08_09_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27724179 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27724179 AND mptpi.`type`=3726 To do Qualite : 0.01983309040855327 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27726015_11-10-2025_09_42_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27726015 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27726015 AND mptpi.`type`=3726 To do Qualite : 0.026475406697071803 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27727889_11-10-2025_11_12_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27727889 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27727889 AND mptpi.`type`=3726 To do Qualite : 0.08563847629458161 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27729672_11-10-2025_12_45_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27729672 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27729672 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'11102025': {'nb_upload': 9, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1388930098, 1388930093, 1388930089, 1388930086, 1388930081, 1388930079, 1388930077, 1388930071, 1388930068] Looping around the photos to save general results len do output : 1 /27729672Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930098', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930093', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930089', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930086', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930081', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930079', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930077', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930071', None, None, None, None, None, '3929033') ('3318', None, None, None, None, None, None, None, '3929033') ('3318', '27729672', '1388930068', None, None, None, None, None, '3929033') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.03767824172973633 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.2954494953155518 time spend to save output : 0.03786730766296387 total time spend for step 10 : 2.3333168029785156 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 9 set_done_treatment 119.12user 109.04system 4:45.65elapsed 79%CPU (0avgtext+0avgdata 4435112maxresident)k 725976inputs+132224outputs (1626major+10013789minor)pagefaults 0swaps